Jun 30 15:59:25 devstack cinder-volume[82614]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 30 15:59:25 devstack cinder-volume[82614]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 30 15:59:25 devstack cinder-volume[82614]: we strongly recommend against using it for new projects. Jun 30 15:59:25 devstack cinder-volume[82614]: If you are already using Eventlet, we recommend migrating to a different Jun 30 15:59:25 devstack cinder-volume[82614]: framework. For more detail see Jun 30 15:59:25 devstack cinder-volume[82614]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 30 15:59:25 devstack cinder-volume[82614]: import eventlet # noqa Jun 30 15:59:27 devstack cinder-volume[82614]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82614) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 30 15:59:27 devstack cinder-volume[82614]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82614) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 30 15:59:27 devstack cinder-volume[82614]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82614) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 30 15:59:28 devstack cinder-volume[82614]: INFO dbcounter [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Registered counter for database cinder Jun 30 15:59:28 devstack cinder-volume[82614]: DEBUG oslo_db.sqlalchemy.engines [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82614) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 30 15:59:28 devstack cinder-volume[82614]: DEBUG dbcounter [-] [82614] Writer thread running {{(pid=82614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 30 15:59:28 devstack cinder-volume[82614]: INFO cinder.rpc [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 30 15:59:28 devstack cinder-volume[82614]: INFO cinder.rpc [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_db.sqlalchemy.engines [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82614) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 30 15:59:29 devstack cinder-volume[82614]: INFO cinder.volume.manager [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Determined volume DB was empty at startup. Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG cinder.volume.manager [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82614) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 30 15:59:29 devstack cinder-volume[82614]: INFO cinder.volume.manager [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 30 15:59:29 devstack cinder-volume[82614]: WARNING stevedore.named [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 30 15:59:29 devstack cinder-volume[82614]: WARNING castellan.key_manager [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 30 15:59:29 devstack cinder-volume[82614]: WARNING cinder.keymgr.conf_key_mgr [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG cinder.volume.drivers.lvm [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82614) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_concurrency.processutils [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_concurrency.processutils [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] CMD "cinder-rtstool verify" returned: 0 in 0.398s {{(pid=82614) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_db.sqlalchemy.engines [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82614) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 30 15:59:29 devstack cinder-volume[82614]: INFO cinder.rpc [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 30 15:59:29 devstack cinder-volume[82614]: INFO cinder.rpc [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 30 15:59:29 devstack cinder-volume[82614]: WARNING stevedore.named [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 30 15:59:29 devstack cinder-volume[82614]: WARNING castellan.key_manager [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 30 15:59:29 devstack cinder-volume[82614]: INFO cinder.volume.manager [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_db.sqlalchemy.engines [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82614) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 30 15:59:29 devstack cinder-volume[82614]: INFO oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Starting 1 workers Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Started child 82752 {{(pid=82614) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Full set of CONF: {{(pid=82614) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] ******************************************************************************** {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Configuration options gathered from: {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] ================================================================================ {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] allow_availability_zone_fallback = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] allow_compression_on_image_upload = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] allowed_direct_url_schemes = [] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82752]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] api_rate_limit = True {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] auth_strategy = keystone {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] az_cache_duration = 3600 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_availability_zone = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_host = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_name = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_stats_polling_interval = 60 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backup_api_class = cinder.backup.api.API {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backup_name_template = backup-%s {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backup_use_same_host = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backup_use_temp_snapshot = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] chap_password = **** {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] chap_username = {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cinder_internal_tenant_project_id = 5d0f2eac1aef438ab199043492dc050e {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cinder_internal_tenant_user_id = 733118733e104bbbbecab773ae170597 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cloned_volume_same_az = True {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cluster = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] compression_format = gzip {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] compute_api_class = cinder.compute.nova.API {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] config_dir = [] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] config_source = [] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] control_exchange = openstack {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] debug = True {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] default_availability_zone = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] default_group_type = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] default_volume_type = lvmdriver-1 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] disk_geometry = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] driver_client_cert = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] driver_client_cert_key = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] driver_data_namespace = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] driver_ssl_cert_path = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] driver_ssl_cert_verify = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] driver_use_ssl = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] enable_force_upload = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] enable_new_services = True {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] enable_unsupported_driver = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] enforce_multipath_for_image_xfer = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] filter_function = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] glance_api_insecure = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] glance_api_servers = ['http://192.168.122.98/image'] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] glance_api_ssl_compression = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] glance_ca_certificates_file = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] glance_catalog_info = image:glance:publicURL {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] glance_certfile = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] glance_keyfile = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] glance_num_retries = 3 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] glance_request_timeout = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] goodness_function = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] graceful_shutdown_timeout = 5 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] group_api_class = cinder.group.api.API {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] host = devstack {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] image_compress_on_upload = True {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] image_conversion_address_space_limit = 1 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] image_conversion_cpu_limit = 60 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] image_conversion_disable = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] image_upload_use_cinder_backend = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] image_upload_use_internal_tenant = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] image_volume_cache_enabled = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] image_volume_cache_max_count = 0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] image_volume_cache_max_size_gb = 0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] init_host_max_objects_retrieval = 0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] instance_format = [instance: %(uuid)s] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] iscsi_target_flags = {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] iscsi_write_cache = on {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] iser_helper = tgtadm {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] iser_ip_address = 192.168.122.98 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] iser_port = 3260 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] log_color = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] log_config_append = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] log_dir = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] log_file = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] log_options = True {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] log_rotate_interval = 1 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] log_rotate_interval_type = days {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] log_rotation_type = none {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] max_age = 0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] max_logfile_count = 30 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] max_logfile_size_mb = 200 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] max_over_subscription_ratio = 20.0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] message_reap_interval = 86400 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] message_ttl = 2592000 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] migration_create_volume_timeout_secs = 300 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] monkey_patch = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] monkey_patch_modules = [] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] my_ip = 192.168.122.98 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] no_snapshot_gb_quota = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] num_iser_scan_tries = 3 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] num_shell_tries = 3 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] num_volume_device_scan_tries = 3 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] nvmeof_conn_info_version = 1 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] nvmet_ns_id = 10 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] nvmet_port_id = 1 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] osapi_max_limit = 1000 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] osapi_volume_ext_list = [] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] osapi_volume_listen_port = 8776 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] osapi_volume_use_ssl = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] osapi_volume_workers = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] per_volume_size_limit = -1 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] periodic_fuzzy_delay = 60 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] periodic_interval = 60 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] public_endpoint = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] publish_errors = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] quota_backup_gigabytes = 1000 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] quota_backups = 10 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] quota_gigabytes = 1000 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] quota_groups = 10 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] quota_snapshots = 10 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] quota_volumes = 10 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] rate_limit_burst = 0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] rate_limit_except_level = CRITICAL {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] rate_limit_interval = 0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] reinit_driver_count = 3 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] replication_device = **** {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] report_discard_supported = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] report_interval = 120 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] reservation_clean_interval = 86400 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] reservation_expire = 86400 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] reserved_image_namespaces = [] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] reserved_percentage = 0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] rpc_response_timeout = 120 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] run_external_periodic_tasks = True {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] scst_target_driver = iscsi {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82752]: INFO cinder.volume.manager [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] scst_target_iqn_name = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] service_down_time = 720 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] shell_completion = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] snapshot_name_template = snapshot-%s {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] snapshot_same_host = True {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] split_loggers = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] state_path = /opt/stack/data/cinder {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] storage_availability_zone = nova {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] storage_protocol = iSCSI {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] syslog_log_facility = LOG_USER {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] target_helper = lioadm {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] target_ip_address = 192.168.122.98 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] target_port = 3260 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] target_protocol = iscsi {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] target_secondary_ip_addresses = [] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] trace_flags = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] transport_url = **** {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] until_refresh = 0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] use_chap_auth = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] use_default_quota_class = True {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] use_journal = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] use_json = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] use_multipath_for_image_xfer = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] use_stderr = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] use_syslog = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] verify_glance_signatures = enabled {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] volume_api_class = cinder.volume.api.API {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] volume_backend_name = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] volume_clear = zero {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] volume_clear_ionice = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] volume_clear_size = 0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] volume_copy_bps_limit = 0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] volume_dd_blocksize = 1M {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] volume_name_template = volume-%s {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] volume_service_inithost_offload = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] volume_usage_audit_period = month {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] zoning_mode = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_concurrency.disable_process_locking = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.auth_section = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.auth_type = password {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.auth_version = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.cache = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.certfile = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.include_service_catalog = True {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.insecure = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.interface = public {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.keyfile = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.memcache_password = {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.memcache_username = {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.region_name = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.service_type = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.98/identity {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.backend = dogpile.cache.null {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.backend_argument = **** {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.backend_expiration_time = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.config_prefix = cache.oslo {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.debug_cache_backend = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.enable_retry_client = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.enable_socket_keepalive = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.enabled = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.expiration_time = 600 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.hashclient_retry_attempts = 2 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.memcache_dead_retry = 300 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.memcache_pool_maxsize = 10 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.memcache_sasl_enabled = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.password = **** {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.proxies = [] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.redis_db = 0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.redis_server = localhost:6379 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.retry_attempts = 2 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.retry_delay = 0.0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.socket_keepalive_count = 1 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.socket_keepalive_idle = 1 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.socket_keepalive_interval = 1 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.socket_timeout = 1.0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.tls_allowed_ciphers = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.tls_cafile = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.tls_certfile = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.tls_enabled = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.tls_keyfile = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cache.username = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] coordination.backend_url = **** {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] database.asyncio_connection = **** {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] database.asyncio_slave_connection = **** {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] database.backend = sqlalchemy {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] database.connection = **** {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] database.connection_debug = 0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] database.connection_parameters = {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] database.connection_recycle_time = 3600 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] database.connection_trace = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] database.db_inc_retry_interval = True {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] database.db_max_retries = 20 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] database.db_max_retry_interval = 10 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] database.db_retry_interval = 1 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] database.max_overflow = 50 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] database.max_pool_size = 5 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] database.max_retries = 10 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] database.mysql_wsrep_sync_wait = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] database.pool_timeout = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] database.retry_interval = 10 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] database.slave_connection = **** {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] database.sqlite_synchronous = True {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] database.synchronous_reader = True {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] database.use_db_reconnect = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] profiler.connection_string = messaging:// {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] profiler.enabled = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] profiler.es_doc_type = notification {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] profiler.es_scroll_size = 10000 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] profiler.es_scroll_time = 2m {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] profiler.filter_error_trace = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] profiler.hmac_keys = **** {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] profiler.sentinel_service_name = mymaster {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] profiler.socket_timeout = 0.1 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] profiler.trace_requests = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] profiler.trace_sqlalchemy = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] profiler_jaeger.process_tags = {} {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] profiler_jaeger.service_name_prefix = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] profiler_otlp.service_name_prefix = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_policy.enforce_new_defaults = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: WARNING oslo_config.cfg [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_policy.enforce_scope = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_policy.policy_default_rule = default {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_policy.policy_file = policy.yaml {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.053s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] privsep_osbrick.group = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] privsep_osbrick.helper_command = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] privsep_osbrick.user = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cinder_sys_admin.group = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cinder_sys_admin.helper_command = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] cinder_sys_admin.user = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] service_user.auth_section = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] service_user.auth_type = password {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] service_user.cafile = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] service_user.certfile = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] service_user.collect_timing = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] service_user.insecure = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] service_user.keyfile = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] service_user.send_service_user_token = True {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] service_user.split_loggers = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] service_user.timeout = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] glance.auth_section = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] glance.auth_type = password {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] glance.certfile = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] glance.collect_timing = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] glance.insecure = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] glance.keyfile = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] glance.region_name = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] glance.split_loggers = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] glance.timeout = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.backend_availability_zone = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.chap_password = **** {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.chap_username = {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.disk_geometry = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.driver_client_cert = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.driver_client_cert_key = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.driver_data_namespace = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:29 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.driver_use_ssl = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.extra_capabilities = {} {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.filter_function = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:29 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.goodness_function = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.iscsi_target_flags = {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.iscsi_write_cache = on {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.iser_helper = tgtadm {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.iser_ip_address = 192.168.122.98 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.iser_port = 3260 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.lvm_share_target = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.lvm_type = auto {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.num_shell_tries = 3 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.replication_device = **** {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.report_discard_supported = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.reserved_percentage = 0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.target_helper = tgtadm {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.target_ip_address = 192.168.122.98 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.target_port = 3260 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.target_protocol = iscsi {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.trace_flags = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.unique_fqdn_network = True {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.use_chap_auth = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.volume_backend_name = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.volume_clear = zero {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.volume_clear_ionice = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.volume_clear_size = 0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_reports.file_event_handler = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_reports.log_dir = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack sudo[82757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.backend_host = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.chap_password = **** {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.chap_username = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack sudo[82757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.disk_geometry = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.driver_client_cert = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.extra_capabilities = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.filter_function = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.goodness_function = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.iser_helper = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.iser_ip_address = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.iser_port = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.lvm_share_target = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.lvm_type = auto {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.num_shell_tries = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.replication_device = **** {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.report_discard_supported = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.reserved_percentage = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.scst_target_driver = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.storage_protocol = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.target_helper = lioadm {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.target_ip_address = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.target_port = 3260 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.trace_flags = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.use_chap_auth = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.volume_clear = zero {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.volume_clear_size = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] lvmdriver-1.volumes_dir = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.ssl = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_notifications.driver = [] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_notifications.retry = -1 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] key_manager.fixed_key = **** {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican.barbican_api_version = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican.barbican_endpoint = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican.barbican_endpoint_type = public {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican.barbican_region_name = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican.cafile = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican.certfile = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican.collect_timing = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican.insecure = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican.keyfile = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican.number_of_retries = 60 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican.retry_delay = 1 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican.send_service_user_token = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican.split_loggers = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican.timeout = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican.verify_ssl = True {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican.verify_ssl_path = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican_service_user.auth_section = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican_service_user.auth_type = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican_service_user.cafile = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican_service_user.certfile = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican_service_user.collect_timing = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican_service_user.insecure = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican_service_user.keyfile = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican_service_user.split_loggers = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] barbican_service_user.timeout = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] vault.approle_role_id = **** {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] vault.approle_secret_id = **** {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] vault.kv_mountpoint = secret {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] vault.kv_path = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] vault.kv_version = 2 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] vault.namespace = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] vault.root_token_id = **** {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] vault.ssl_ca_crt_file = None {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] vault.timeout = 60.0 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] vault.use_ssl = False {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 15:59:30 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] ******************************************************************************** {{(pid=82614) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 30 15:59:30 devstack sudo[82757]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:30 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.693s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:30 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:30 devstack sudo[82762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 30 15:59:30 devstack sudo[82762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:31 devstack sudo[82762]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:31 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.655s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:31 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 15:59:31 devstack cinder-volume[82752]: INFO cinder.brick.local_dev.lvm [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 30 15:59:31 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:31 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:31 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:31 devstack sudo[83012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 30 15:59:31 devstack sudo[83012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:31 devstack sudo[83012]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:32 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:32 devstack cinder-volume[82752]: DEBUG cinder.brick.local_dev.lvm [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82752) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 30 15:59:32 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:32 devstack sudo[83227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 30 15:59:32 devstack sudo[83227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:33 devstack sudo[83227]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:33 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.545s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:33 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:33 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:33 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:33 devstack sudo[83515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 30 15:59:33 devstack sudo[83515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:34 devstack sudo[83515]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:34 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.833s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:34 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:34 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:34 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:34 devstack sudo[83538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 30 15:59:34 devstack sudo[83538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:35 devstack sudo[83538]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:35 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.852s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:35 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:35 devstack sudo[83542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 30 15:59:35 devstack sudo[83542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:36 devstack sudo[83542]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:36 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.970s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:36 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:36 devstack sudo[83555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 30 15:59:36 devstack sudo[83555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:37 devstack sudo[83555]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:37 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.911s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:37 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:37 devstack sudo[83564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 30 15:59:37 devstack sudo[83564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:37 devstack sudo[83564]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:37 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.774s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:37 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:37 devstack sudo[83568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 30 15:59:37 devstack sudo[83568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:38 devstack sudo[83568]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:38 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.790s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:38 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:38 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:38 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:38 devstack sudo[83577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 30 15:59:38 devstack sudo[83577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:39 devstack sudo[83577]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:39 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.856s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:39 devstack cinder-volume[82752]: INFO cinder.volume.drivers.lvm [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 30 15:59:39 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:39 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:39 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:39 devstack sudo[83695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 30 15:59:39 devstack sudo[83695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:39 devstack cinder-volume[82614]: DEBUG dbcounter [-] [82614] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82614) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 15:59:40 devstack sudo[83695]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:40 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.663s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:40 devstack cinder-volume[82752]: DEBUG cinder.volume.drivers.lvm [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Updating volume stats {{(pid=82752) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 30 15:59:40 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:40 devstack sudo[83836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 30 15:59:40 devstack sudo[83836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:40 devstack sudo[83836]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:40 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:40 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:40 devstack sudo[83840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 30 15:59:40 devstack sudo[83840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:41 devstack sudo[83840]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:41 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:41 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:41 devstack sudo[83843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 30 15:59:41 devstack sudo[83843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:42 devstack sudo[83843]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:42 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.723s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:42 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:42 devstack sudo[83853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 30 15:59:42 devstack sudo[83853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:42 devstack sudo[83853]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:42 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:42 devstack cinder-volume[82752]: INFO cinder.volume.driver [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Driver hasn't implemented _init_vendor_properties() Jun 30 15:59:42 devstack cinder-volume[82752]: DEBUG cinder.volume.driver [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82752) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 30 15:59:43 devstack cinder-volume[82752]: DEBUG oslo_db.sqlalchemy.engines [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82752) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 30 15:59:43 devstack cinder-volume[82752]: DEBUG dbcounter [-] [82752] Writer thread running {{(pid=82752) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 30 15:59:43 devstack cinder-volume[82752]: DEBUG cinder.db.api [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Building query based on filter {{(pid=82752) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 30 15:59:43 devstack cinder-volume[82752]: DEBUG cinder.image.image_utils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82752) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 30 15:59:43 devstack cinder-volume[82752]: INFO cinder.keymgr.migration [None req-5db823a5-91bb-4e3a-b46a-0d2f6c7f319c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 30 15:59:43 devstack cinder-volume[82752]: DEBUG cinder.volume.drivers.lvm [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Updating volume stats {{(pid=82752) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 30 15:59:43 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:43 devstack sudo[83860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 30 15:59:43 devstack sudo[83860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:43 devstack sudo[83860]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:43 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:43 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:43 devstack sudo[83863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 30 15:59:43 devstack sudo[83863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:44 devstack sudo[83863]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:44 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.686s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:44 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:44 devstack sudo[83866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 30 15:59:44 devstack sudo[83866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:45 devstack sudo[83866]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:45 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.657s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:45 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:45 devstack sudo[83870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 30 15:59:45 devstack sudo[83870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:45 devstack sudo[83870]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:45 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.722s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:45 devstack cinder-volume[82752]: DEBUG cinder.manager [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Notifying Schedulers of capabilities ... {{(pid=82752) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 15:59:45 devstack cinder-volume[82752]: INFO cinder.volume.manager [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Driver initialization completed successfully. Jun 30 15:59:45 devstack cinder-volume[82752]: INFO cinder.manager [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Initiating service 2 cleanup Jun 30 15:59:45 devstack cinder-volume[82752]: INFO cinder.manager [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Service 2 cleanup completed. Jun 30 15:59:45 devstack cinder-volume[82752]: DEBUG cinder.service [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Creating RPC server for service cinder-volume {{(pid=82752) start /opt/stack/cinder/cinder/service.py:231}} Jun 30 15:59:45 devstack cinder-volume[82752]: DEBUG cinder.service [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82752) start /opt/stack/cinder/cinder/service.py:237}} Jun 30 15:59:46 devstack cinder-volume[82752]: INFO cinder.volume.manager [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 30 15:59:46 devstack cinder-volume[82752]: DEBUG cinder.volume.drivers.lvm [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Updating volume stats {{(pid=82752) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 30 15:59:46 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:46 devstack sudo[83878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 30 15:59:46 devstack sudo[83878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:46 devstack sudo[83878]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:46 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.781s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:46 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:46 devstack sudo[83881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 30 15:59:46 devstack sudo[83881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:47 devstack sudo[83881]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:47 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:47 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:47 devstack sudo[83938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 30 15:59:47 devstack sudo[83938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:48 devstack sudo[83938]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:48 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.635s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:48 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 15:59:48 devstack sudo[83941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 30 15:59:48 devstack sudo[83941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 15:59:48 devstack sudo[83941]: pam_unix(sudo:session): session closed for user root Jun 30 15:59:48 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 15:59:48 devstack cinder-volume[82752]: INFO cinder.volume.manager [None req-0a276ebd-8f48-407c-9fdf-cd38241d77ed None None] Driver post RPC initialization completed successfully. Jun 30 15:59:58 devstack cinder-volume[82752]: DEBUG dbcounter [-] [82752] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82752) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 15:59:58 devstack cinder-volume[82752]: DEBUG dbcounter [-] [82752] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=82752) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:00:41 devstack cinder-volume[82752]: DEBUG oslo_service.periodic_task [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82752) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:00:41 devstack cinder-volume[82752]: DEBUG cinder.volume.drivers.lvm [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Updating volume stats {{(pid=82752) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 30 16:00:41 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:00:41 devstack sudo[85625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 30 16:00:41 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:00:42 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root Jun 30 16:00:42 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:00:42 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:00:42 devstack sudo[85634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 30 16:00:42 devstack sudo[85634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:00:43 devstack sudo[85634]: pam_unix(sudo:session): session closed for user root Jun 30 16:00:43 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:00:43 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:00:43 devstack sudo[85655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 30 16:00:43 devstack sudo[85655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:00:43 devstack sudo[85655]: pam_unix(sudo:session): session closed for user root Jun 30 16:00:43 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.637s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:00:43 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:00:43 devstack sudo[85658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 30 16:00:43 devstack sudo[85658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:00:44 devstack sudo[85658]: pam_unix(sudo:session): session closed for user root Jun 30 16:00:44 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:00:44 devstack cinder-volume[82752]: DEBUG cinder.manager [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Notifying Schedulers of capabilities ... {{(pid=82752) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:00:44 devstack cinder-volume[82752]: DEBUG oslo_service.periodic_task [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Running periodic task VolumeManager._thread_info {{(pid=82752) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:00:44 devstack cinder-volume[82752]: DEBUG cinder.volume.manager [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] thread count: 6 {{(pid=82752) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:00:44 devstack cinder-volume[82752]: DEBUG cinder.volume.manager [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] thread info: [<_MainThread(MainThread, started 129834437251200)>, , , , , ] {{(pid=82752) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:01:41 devstack cinder-volume[82752]: DEBUG oslo_service.periodic_task [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82752) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:01:41 devstack cinder-volume[82752]: DEBUG cinder.volume.drivers.lvm [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Updating volume stats {{(pid=82752) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 30 16:01:41 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:01:41 devstack sudo[88848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 30 16:01:41 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:01:42 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root Jun 30 16:01:42 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:01:42 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:01:42 devstack sudo[88866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 30 16:01:42 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:01:43 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root Jun 30 16:01:43 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.689s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:01:43 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:01:43 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 30 16:01:43 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:01:43 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Jun 30 16:01:43 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.631s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:01:43 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:01:43 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 30 16:01:43 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:01:44 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Jun 30 16:01:44 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.604s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:01:44 devstack cinder-volume[82752]: DEBUG cinder.manager [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Notifying Schedulers of capabilities ... {{(pid=82752) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:01:58 devstack cinder-volume[82752]: DEBUG dbcounter [-] [82752] Writing DB stats cinder:SELECT=1 {{(pid=82752) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:01:58 devstack cinder-volume[82752]: DEBUG dbcounter [-] [82752] Writing DB stats cinder:UPDATE=1 {{(pid=82752) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:02:41 devstack cinder-volume[82752]: DEBUG oslo_service.periodic_task [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82752) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:02:41 devstack cinder-volume[82752]: DEBUG cinder.volume.drivers.lvm [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Updating volume stats {{(pid=82752) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 30 16:02:41 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:02:41 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 30 16:02:41 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:02:42 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Jun 30 16:02:42 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:02:42 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:02:42 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 30 16:02:42 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:02:43 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Jun 30 16:02:43 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:02:43 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:02:43 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 30 16:02:43 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:02:43 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Jun 30 16:02:43 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.732s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:02:43 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:02:43 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 30 16:02:43 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:02:44 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Jun 30 16:02:44 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:02:44 devstack cinder-volume[82752]: DEBUG cinder.manager [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Notifying Schedulers of capabilities ... {{(pid=82752) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:02:44 devstack cinder-volume[82752]: DEBUG oslo_service.periodic_task [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Running periodic task VolumeManager._thread_info {{(pid=82752) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:02:44 devstack cinder-volume[82752]: DEBUG cinder.volume.manager [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] thread count: 6 {{(pid=82752) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:02:44 devstack cinder-volume[82752]: DEBUG cinder.volume.manager [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] thread info: [<_MainThread(MainThread, started 129834437251200)>, , , , , ] {{(pid=82752) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:03:41 devstack cinder-volume[82752]: DEBUG oslo_service.periodic_task [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82752) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:03:41 devstack cinder-volume[82752]: DEBUG cinder.volume.drivers.lvm [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Updating volume stats {{(pid=82752) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 30 16:03:41 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:03:41 devstack sudo[92127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 30 16:03:41 devstack sudo[92127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:03:42 devstack sudo[92127]: pam_unix(sudo:session): session closed for user root Jun 30 16:03:42 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:03:42 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:03:42 devstack sudo[92137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 30 16:03:42 devstack sudo[92137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:03:43 devstack sudo[92137]: pam_unix(sudo:session): session closed for user root Jun 30 16:03:43 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:03:43 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:03:43 devstack sudo[92140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 30 16:03:43 devstack sudo[92140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:03:43 devstack sudo[92140]: pam_unix(sudo:session): session closed for user root Jun 30 16:03:43 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.648s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:03:43 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:03:43 devstack sudo[92146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 30 16:03:43 devstack sudo[92146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:03:44 devstack sudo[92146]: pam_unix(sudo:session): session closed for user root Jun 30 16:03:44 devstack cinder-volume[82752]: DEBUG oslo_concurrency.processutils [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=82752) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:03:44 devstack cinder-volume[82752]: DEBUG cinder.manager [None req-71465e8f-1509-48c8-8f06-77e73a8b774d None None] Notifying Schedulers of capabilities ... {{(pid=82752) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:03:58 devstack cinder-volume[82752]: DEBUG dbcounter [-] [82752] Writing DB stats cinder:SELECT=1 {{(pid=82752) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:03:58 devstack cinder-volume[82752]: DEBUG dbcounter [-] [82752] Writing DB stats cinder:UPDATE=1 {{(pid=82752) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:04:06 devstack cinder-volume[82614]: INFO oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Caught SIGTERM, stopping children Jun 30 16:04:06 devstack cinder-volume[82614]: DEBUG oslo_concurrency.lockutils [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Acquiring lock "singleton_lock" {{(pid=82614) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 30 16:04:06 devstack cinder-volume[82614]: DEBUG oslo_concurrency.lockutils [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Acquired lock "singleton_lock" {{(pid=82614) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 30 16:04:06 devstack cinder-volume[82614]: DEBUG oslo_concurrency.lockutils [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Releasing lock "singleton_lock" {{(pid=82614) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 30 16:04:06 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Stop services. {{(pid=82614) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 30 16:04:06 devstack cinder-volume[82614]: DEBUG oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Killing children. {{(pid=82614) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 30 16:04:06 devstack cinder-volume[82614]: INFO oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Waiting on 1 children to exit Jun 30 16:04:11 devstack cinder-volume[82752]: DEBUG oslo_concurrency.lockutils [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Acquiring lock "singleton_lock" {{(pid=82752) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 30 16:04:11 devstack cinder-volume[82752]: DEBUG oslo_concurrency.lockutils [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Acquired lock "singleton_lock" {{(pid=82752) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 30 16:04:11 devstack cinder-volume[82752]: DEBUG oslo_concurrency.lockutils [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Releasing lock "singleton_lock" {{(pid=82752) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 30 16:04:11 devstack cinder-volume[82752]: WARNING amqp [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 30 16:04:11 devstack cinder-volume[82752]: WARNING amqp [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 30 16:04:11 devstack cinder-volume[82614]: INFO oslo_service.backend._eventlet.service [None req-e9806bec-e4e9-4ec5-b56d-eb835ab4ad22 None None] Child 82752 exited with status 0 Jun 30 16:04:11 devstack cinder-volume[92840]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 30 16:04:11 devstack cinder-volume[92840]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 30 16:04:11 devstack cinder-volume[92840]: we strongly recommend against using it for new projects. Jun 30 16:04:11 devstack cinder-volume[92840]: If you are already using Eventlet, we recommend migrating to a different Jun 30 16:04:11 devstack cinder-volume[92840]: framework. For more detail see Jun 30 16:04:11 devstack cinder-volume[92840]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 30 16:04:11 devstack cinder-volume[92840]: import eventlet # noqa Jun 30 16:04:13 devstack cinder-volume[92840]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92840) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 30 16:04:13 devstack cinder-volume[92840]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92840) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 30 16:04:13 devstack cinder-volume[92840]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92840) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 30 16:04:14 devstack cinder-volume[92840]: INFO dbcounter [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Registered counter for database cinder Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_db.sqlalchemy.engines [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92840) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG dbcounter [-] [92840] Writer thread running {{(pid=92840) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 30 16:04:14 devstack cinder-volume[92840]: INFO cinder.rpc [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 30 16:04:14 devstack cinder-volume[92840]: INFO cinder.rpc [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_db.sqlalchemy.engines [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92840) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 30 16:04:14 devstack cinder-volume[92840]: INFO cinder.volume.manager [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Determined volume DB was empty at startup. Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG cinder.volume.manager [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92840) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 30 16:04:14 devstack cinder-volume[92840]: INFO cinder.volume.manager [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 30 16:04:14 devstack cinder-volume[92840]: WARNING stevedore.named [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 30 16:04:14 devstack cinder-volume[92840]: WARNING castellan.key_manager [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 30 16:04:14 devstack cinder-volume[92840]: WARNING cinder.keymgr.conf_key_mgr [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 30 16:04:14 devstack cinder-volume[92840]: INFO cinder.volume.manager [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_db.sqlalchemy.engines [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92840) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 30 16:04:14 devstack cinder-volume[92840]: INFO oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Starting 1 workers Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Started child 93056 {{(pid=92840) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Full set of CONF: {{(pid=92840) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] ******************************************************************************** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Configuration options gathered from: {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] ================================================================================ {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] allow_availability_zone_fallback = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] allow_compression_on_image_upload = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] allowed_direct_url_schemes = [] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] api_rate_limit = True {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] auth_strategy = keystone {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_availability_zone = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_host = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_name = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_stats_polling_interval = 60 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backup_api_class = cinder.backup.api.API {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backup_name_template = backup-%s {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backup_use_same_host = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backup_use_temp_snapshot = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] chap_password = **** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] chap_username = {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cinder_internal_tenant_project_id = 5d0f2eac1aef438ab199043492dc050e {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[93056]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cinder_internal_tenant_user_id = 733118733e104bbbbecab773ae170597 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cluster = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] compression_format = gzip {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] compute_api_class = cinder.compute.nova.API {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] config_dir = [] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] config_source = [] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] control_exchange = openstack {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] debug = True {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] default_availability_zone = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] default_group_type = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] default_volume_type = QuobyteHD {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] disk_geometry = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] driver_client_cert = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] driver_client_cert_key = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] driver_data_namespace = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] driver_ssl_cert_path = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] driver_ssl_cert_verify = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] driver_use_ssl = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] enable_new_services = True {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] enable_unsupported_driver = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] enabled_backends = ['QuobyteHD'] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] enforce_multipath_for_image_xfer = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] filter_function = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] glance_api_insecure = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] glance_api_servers = ['http://192.168.122.98/image'] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] glance_api_ssl_compression = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] glance_ca_certificates_file = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] glance_catalog_info = image:glance:publicURL {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] glance_certfile = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] glance_keyfile = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] glance_num_retries = 3 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] glance_request_timeout = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] goodness_function = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[93056]: INFO cinder.volume.manager [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Starting volume driver QuobyteDriver (1.1.14) Jun 30 16:04:14 devstack cinder-volume[93056]: DEBUG cinder.volume.drivers.remotefs [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93056) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] graceful_shutdown_timeout = 5 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] group_api_class = cinder.group.api.API {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] host = devstack {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] image_compress_on_upload = True {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] image_conversion_address_space_limit = 1 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] image_conversion_cpu_limit = 60 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] image_conversion_disable = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] image_upload_use_cinder_backend = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] image_upload_use_internal_tenant = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] image_volume_cache_enabled = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] image_volume_cache_max_count = 0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] image_volume_cache_max_size_gb = 0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] init_host_max_objects_retrieval = 0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] instance_format = [instance: %(uuid)s] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] iscsi_target_flags = {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] iscsi_write_cache = on {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] iser_helper = tgtadm {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] iser_ip_address = 192.168.122.98 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] iser_port = 3260 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] log_color = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] log_config_append = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] log_dir = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] log_file = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] log_options = True {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] log_rotate_interval = 1 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] log_rotate_interval_type = days {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] log_rotation_type = none {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] max_age = 0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] max_logfile_count = 30 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] max_logfile_size_mb = 200 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] max_over_subscription_ratio = 20.0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] message_reap_interval = 86400 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] message_ttl = 2592000 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] migration_create_volume_timeout_secs = 300 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] monkey_patch = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] monkey_patch_modules = [] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] my_ip = 192.168.122.98 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] no_snapshot_gb_quota = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] num_iser_scan_tries = 3 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] num_shell_tries = 3 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] num_volume_device_scan_tries = 3 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] nvmeof_conn_info_version = 1 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] nvmet_ns_id = 10 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] nvmet_port_id = 1 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] osapi_max_limit = 1000 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] osapi_volume_ext_list = [] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] osapi_volume_listen = 0.0.0.0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] osapi_volume_listen_port = 8776 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] osapi_volume_use_ssl = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] osapi_volume_workers = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] per_volume_size_limit = -1 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] periodic_fuzzy_delay = 60 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] periodic_interval = 60 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] project_id_regex = [0-9a-f\-]+ {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] public_endpoint = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] publish_errors = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] quota_backup_gigabytes = 1000 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] quota_backups = 10 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] quota_gigabytes = 1000 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] quota_groups = 10 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] quota_snapshots = 10 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] quota_volumes = 10 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] rate_limit_burst = 0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] rate_limit_except_level = CRITICAL {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] rate_limit_interval = 0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] reinit_driver_count = 3 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] replication_device = **** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] report_discard_supported = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] report_interval = 120 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] reservation_clean_interval = 86400 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] reservation_expire = 86400 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] reserved_image_namespaces = [] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] reserved_percentage = 0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] rpc_response_timeout = 120 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] run_external_periodic_tasks = True {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] scst_target_driver = iscsi {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] scst_target_iqn_name = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] service_down_time = 720 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] shell_completion = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] snapshot_name_template = snapshot-%s {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] split_loggers = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] state_path = /opt/stack/data/cinder {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] storage_availability_zone = nova {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] storage_protocol = iSCSI {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] syslog_log_facility = LOG_USER {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] target_helper = lioadm {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] target_ip_address = 192.168.122.98 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] target_port = 3260 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] target_protocol = iscsi {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[93056]: DEBUG cinder.volume.drivers.quobyte [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93056) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 30 16:04:14 devstack cinder-volume[93056]: WARNING cinder.volume.drivers.quobyte [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 30 16:04:14 devstack cinder-volume[93056]: WARNING cinder.volume.drivers.quobyte [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] target_secondary_ip_addresses = [] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] trace_flags = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[93056]: DEBUG oslo_concurrency.processutils [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Running cmd (subprocess): mount.quobyte {{(pid=93056) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] transfer_api_class = cinder.transfer.api.API {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] transport_url = **** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] until_refresh = 0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] use_chap_auth = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] use_default_quota_class = True {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] use_journal = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] use_json = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] use_multipath_for_image_xfer = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] use_stderr = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] use_syslog = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] verify_glance_signatures = enabled {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] volume_api_class = cinder.volume.api.API {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] volume_backend_name = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] volume_clear = zero {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] volume_clear_ionice = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] volume_clear_size = 0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] volume_copy_bps_limit = 0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] volume_dd_blocksize = 1M {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] volume_name_template = volume-%s {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] volume_service_inithost_offload = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] volume_usage_audit_period = month {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] zoning_mode = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_concurrency.disable_process_locking = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:14 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.auth_section = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.auth_type = password {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.auth_version = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.cache = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.certfile = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.delay_auth_decision = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.http_connect_timeout = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.include_service_catalog = True {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.insecure = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.interface = public {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.keyfile = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.memcache_password = {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.memcache_username = {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.region_name = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.service_token_roles_required = True {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.service_type = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.token_cache_time = 300 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.98/identity {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.backend = dogpile.cache.null {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.backend_argument = **** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.backend_expiration_time = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.config_prefix = cache.oslo {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.debug_cache_backend = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.enable_retry_client = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.enable_socket_keepalive = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.enabled = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.expiration_time = 600 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.hashclient_retry_attempts = 2 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.memcache_dead_retry = 300 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.memcache_pool_maxsize = 10 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.memcache_sasl_enabled = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.password = **** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.proxies = [] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.redis_db = 0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.redis_sentinel_service_name = mymaster {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.redis_server = localhost:6379 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.retry_attempts = 2 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.retry_delay = 0.0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.socket_keepalive_count = 1 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.socket_keepalive_idle = 1 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.socket_keepalive_interval = 1 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.socket_timeout = 1.0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.tls_allowed_ciphers = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.tls_cafile = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.tls_certfile = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.tls_enabled = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.tls_keyfile = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cache.username = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] coordination.backend_url = **** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] database.asyncio_connection = **** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] database.asyncio_slave_connection = **** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] database.backend = sqlalchemy {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] database.connection = **** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] database.connection_debug = 0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] database.connection_parameters = {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] database.connection_recycle_time = 3600 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] database.connection_trace = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] database.db_inc_retry_interval = True {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] database.db_max_retries = 20 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] database.db_max_retry_interval = 10 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] database.db_retry_interval = 1 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] database.max_overflow = 50 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] database.max_pool_size = 5 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] database.max_retries = 10 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] database.mysql_wsrep_sync_wait = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] database.pool_timeout = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] database.retry_interval = 10 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] database.slave_connection = **** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] database.sqlite_synchronous = True {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] database.synchronous_reader = True {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] database.use_db_reconnect = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] profiler.connection_string = messaging:// {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] profiler.enabled = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] profiler.es_doc_type = notification {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] profiler.es_scroll_size = 10000 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] profiler.es_scroll_time = 2m {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] profiler.filter_error_trace = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] profiler.hmac_keys = **** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] profiler.sentinel_service_name = mymaster {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] profiler.socket_timeout = 0.1 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] profiler.trace_requests = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] profiler.trace_sqlalchemy = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] profiler_jaeger.process_tags = {} {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] profiler_jaeger.service_name_prefix = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] profiler_otlp.service_name_prefix = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_policy.enforce_new_defaults = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: WARNING oslo_config.cfg [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_policy.enforce_scope = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_policy.policy_default_rule = default {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_policy.policy_file = policy.yaml {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_policy.remote_timeout = 60.0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack quobyte-client[93057]: Reading configuration file: /etc/quobyte/client.cfg Jun 30 16:04:15 devstack quobyte-client[93057]: Invalid parameters found, error: missing mount point. Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] privsep_osbrick.group = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] privsep_osbrick.helper_command = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack quobyte-client[93057]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] privsep_osbrick.user = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cinder_sys_admin.group = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack quobyte-client[93057]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 30 16:04:15 devstack cinder-volume[93056]: DEBUG oslo_concurrency.processutils [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] CMD "mount.quobyte" returned: 1 in 0.145s {{(pid=93056) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:04:15 devstack cinder-volume[93056]: DEBUG oslo_concurrency.lockutils [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93056) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:04:15 devstack cinder-volume[93056]: DEBUG oslo_concurrency.lockutils [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93056) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:04:15 devstack cinder-volume[93056]: DEBUG cinder.volume.drivers.quobyte [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93056) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cinder_sys_admin.helper_command = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[93056]: INFO cinder.volume.drivers.quobyte [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a ... Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[93056]: DEBUG oslo_concurrency.processutils [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba -c /etc/quobyte/client-cinder.cfg {{(pid=93056) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] cinder_sys_admin.user = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] service_user.auth_section = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] service_user.auth_type = password {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] service_user.cafile = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] service_user.certfile = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] service_user.collect_timing = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] service_user.insecure = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] service_user.keyfile = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] service_user.send_service_user_token = True {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] service_user.split_loggers = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] service_user.timeout = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] glance.auth_section = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] glance.auth_type = password {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] glance.certfile = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] glance.collect_timing = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] glance.insecure = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] glance.keyfile = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] glance.region_name = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] glance.split_loggers = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] glance.timeout = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.backend_availability_zone = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.chap_password = **** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.chap_username = {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.disk_geometry = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.driver_client_cert = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.driver_client_cert_key = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.driver_data_namespace = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack sudo[93062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba -c /etc/quobyte/client-cinder.cfg Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.driver_use_ssl = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack sudo[93062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.enable_unsupported_driver = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.extra_capabilities = {} {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.filter_function = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.goodness_function = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.iscsi_target_flags = {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.iscsi_write_cache = on {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.iser_helper = tgtadm {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.iser_ip_address = 192.168.122.98 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.iser_port = 3260 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.nas_host = {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.nas_login = admin {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.nas_mount_options = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.nas_password = **** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.nas_private_key = {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.nas_share_path = {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.nas_ssh_port = 22 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.num_shell_tries = 3 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.nvmet_port_id = 1 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.quobyte_client_cfg = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.quobyte_volume_url = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.replication_device = **** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.report_discard_supported = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.reserved_percentage = 0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.scst_target_driver = iscsi {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.scst_target_iqn_name = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.storage_protocol = iSCSI {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.target_helper = tgtadm {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.target_ip_address = 192.168.122.98 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.target_port = 3260 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.target_protocol = iscsi {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.trace_flags = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.unique_fqdn_network = True {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.use_chap_auth = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.volume_backend_name = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.volume_clear = zero {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.volume_clear_ionice = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.volume_clear_size = 0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_reports.file_event_handler = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_reports.log_dir = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.backend_availability_zone = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.backend_host = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.chap_password = **** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.chap_username = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.chiscsi_conf = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.disk_geometry = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.driver_client_cert = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.driver_client_cert_key = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.driver_data_namespace = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.driver_use_ssl = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.extra_capabilities = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.filter_function = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.goodness_function = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.iscsi_target_flags = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.iscsi_write_cache = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.iser_helper = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.iser_ip_address = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.iser_port = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.iser_target_prefix = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.nas_host = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.nas_login = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.nas_mount_options = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.nas_password = **** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.nas_private_key = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.nas_share_path = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.nas_ssh_port = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.num_shell_tries = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.nvmet_ns_id = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.nvmet_port_id = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.replication_device = **** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.report_discard_supported = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.reserved_percentage = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.scst_target_driver = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.storage_protocol = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.target_helper = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.target_ip_address = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.target_port = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.target_prefix = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.target_protocol = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.trace_flags = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.unique_fqdn_network = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.use_chap_auth = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.volume_clear = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.volume_clear_ionice = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.volume_clear_size = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] QuobyteHD.volumes_dir = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.ssl = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.ssl_version = {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_notifications.driver = [] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_notifications.retry = -1 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] oslo_messaging_notifications.transport_url = **** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] key_manager.fixed_key = **** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican.barbican_api_version = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican.barbican_endpoint = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican.barbican_endpoint_type = public {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican.barbican_region_name = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican.cafile = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican.certfile = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican.collect_timing = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican.insecure = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican.keyfile = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican.number_of_retries = 60 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican.retry_delay = 1 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican.send_service_user_token = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican.split_loggers = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican.timeout = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican.verify_ssl = True {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican.verify_ssl_path = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican_service_user.auth_section = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican_service_user.auth_type = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican_service_user.cafile = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican_service_user.certfile = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican_service_user.collect_timing = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican_service_user.insecure = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican_service_user.keyfile = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican_service_user.split_loggers = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] barbican_service_user.timeout = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] vault.approle_role_id = **** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] vault.approle_secret_id = **** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] vault.kv_mountpoint = secret {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] vault.kv_path = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] vault.kv_version = 2 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] vault.namespace = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] vault.root_token_id = **** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] vault.ssl_ca_crt_file = None {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] vault.timeout = 60.0 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] vault.use_ssl = False {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:15 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] ******************************************************************************** {{(pid=92840) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 30 16:04:15 devstack sudo[93062]: pam_unix(sudo:session): session closed for user root Jun 30 16:04:15 devstack cinder-volume[93056]: DEBUG oslo_concurrency.processutils [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.805s {{(pid=93056) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:04:15 devstack cinder-volume[93056]: INFO cinder.volume.drivers.quobyte [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a succeeded Jun 30 16:04:15 devstack cinder-volume[93056]: DEBUG cinder.volume.drivers.quobyte [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93056) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:04:15 devstack cinder-volume[93056]: DEBUG oslo_concurrency.lockutils [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.818s {{(pid=93056) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:04:15 devstack cinder-volume[93056]: DEBUG oslo_concurrency.processutils [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93056) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:04:15 devstack sudo[93132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:04:15 devstack sudo[93132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:04:16 devstack sudo[93132]: pam_unix(sudo:session): session closed for user root Jun 30 16:04:16 devstack cinder-volume[93056]: DEBUG oslo_concurrency.processutils [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.625s {{(pid=93056) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:04:16 devstack cinder-volume[93056]: INFO cinder.volume.driver [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Driver hasn't implemented _init_vendor_properties() Jun 30 16:04:16 devstack cinder-volume[93056]: DEBUG cinder.volume.driver [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576904296875, 'free_capacity_gb': 1775.7576904296875, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93056) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 30 16:04:16 devstack cinder-volume[93056]: DEBUG oslo_db.sqlalchemy.engines [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93056) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 30 16:04:16 devstack cinder-volume[93056]: DEBUG dbcounter [-] [93056] Writer thread running {{(pid=93056) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 30 16:04:16 devstack cinder-volume[93056]: DEBUG cinder.db.api [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Building query based on filter {{(pid=93056) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 30 16:04:16 devstack cinder-volume[93056]: DEBUG cinder.image.image_utils [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93056) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 30 16:04:16 devstack cinder-volume[93056]: INFO cinder.keymgr.migration [None req-7870580e-cdd5-44c3-a34a-5104e9bfd2f2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 30 16:04:16 devstack cinder-volume[93056]: DEBUG oslo_concurrency.lockutils [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93056) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:04:16 devstack cinder-volume[93056]: DEBUG oslo_concurrency.lockutils [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93056) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:04:16 devstack cinder-volume[93056]: DEBUG cinder.volume.drivers.quobyte [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93056) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:04:16 devstack cinder-volume[93056]: DEBUG cinder.volume.drivers.quobyte [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93056) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:04:16 devstack cinder-volume[93056]: DEBUG oslo_concurrency.lockutils [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93056) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:04:16 devstack cinder-volume[93056]: DEBUG oslo_concurrency.processutils [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93056) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:04:16 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:04:16 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:04:17 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Jun 30 16:04:17 devstack cinder-volume[93056]: DEBUG oslo_concurrency.processutils [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.618s {{(pid=93056) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:04:17 devstack cinder-volume[93056]: DEBUG cinder.manager [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Notifying Schedulers of capabilities ... {{(pid=93056) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:04:17 devstack cinder-volume[93056]: INFO cinder.volume.manager [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Driver initialization completed successfully. Jun 30 16:04:17 devstack cinder-volume[93056]: INFO cinder.manager [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Initiating service 3 cleanup Jun 30 16:04:17 devstack cinder-volume[93056]: INFO cinder.manager [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Service 3 cleanup completed. Jun 30 16:04:17 devstack cinder-volume[93056]: DEBUG cinder.service [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Creating RPC server for service cinder-volume {{(pid=93056) start /opt/stack/cinder/cinder/service.py:231}} Jun 30 16:04:17 devstack cinder-volume[93056]: DEBUG cinder.service [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93056) start /opt/stack/cinder/cinder/service.py:237}} Jun 30 16:04:17 devstack cinder-volume[93056]: INFO cinder.volume.manager [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 30 16:04:17 devstack cinder-volume[93056]: DEBUG oslo_concurrency.lockutils [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93056) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:04:17 devstack cinder-volume[93056]: DEBUG oslo_concurrency.lockutils [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93056) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:04:17 devstack cinder-volume[93056]: DEBUG cinder.volume.drivers.quobyte [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93056) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:04:17 devstack cinder-volume[93056]: DEBUG cinder.volume.drivers.quobyte [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93056) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:04:17 devstack cinder-volume[93056]: DEBUG oslo_concurrency.lockutils [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93056) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:04:17 devstack cinder-volume[93056]: DEBUG oslo_concurrency.processutils [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93056) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:04:17 devstack sudo[93143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:04:17 devstack sudo[93143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:04:18 devstack sudo[93143]: pam_unix(sudo:session): session closed for user root Jun 30 16:04:18 devstack cinder-volume[93056]: DEBUG oslo_concurrency.processutils [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.924s {{(pid=93056) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:04:18 devstack cinder-volume[93056]: INFO cinder.volume.manager [None req-d3a4c511-b521-4c92-9696-4de14b4cbbdb None None] Driver post RPC initialization completed successfully. Jun 30 16:04:22 devstack cinder-volume[93056]: DEBUG oslo_concurrency.lockutils [None req-42b3fd7d-eeca-4a7a-9c99-298db93187dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93056) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:04:22 devstack cinder-volume[93056]: DEBUG oslo_concurrency.lockutils [None req-42b3fd7d-eeca-4a7a-9c99-298db93187dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93056) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:04:22 devstack cinder-volume[93056]: DEBUG cinder.volume.drivers.quobyte [None req-42b3fd7d-eeca-4a7a-9c99-298db93187dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93056) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:04:22 devstack cinder-volume[93056]: DEBUG cinder.volume.drivers.quobyte [None req-42b3fd7d-eeca-4a7a-9c99-298db93187dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93056) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:04:22 devstack cinder-volume[93056]: DEBUG oslo_concurrency.lockutils [None req-42b3fd7d-eeca-4a7a-9c99-298db93187dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93056) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:04:22 devstack cinder-volume[93056]: DEBUG oslo_concurrency.processutils [None req-42b3fd7d-eeca-4a7a-9c99-298db93187dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93056) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:04:22 devstack sudo[93364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:04:22 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:04:23 devstack cinder-volume[92840]: INFO oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Caught SIGTERM, stopping children Jun 30 16:04:23 devstack cinder-volume[92840]: DEBUG oslo_concurrency.lockutils [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Acquiring lock "singleton_lock" {{(pid=92840) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 30 16:04:23 devstack cinder-volume[92840]: DEBUG oslo_concurrency.lockutils [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Acquired lock "singleton_lock" {{(pid=92840) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 30 16:04:23 devstack cinder-volume[92840]: DEBUG oslo_concurrency.lockutils [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Releasing lock "singleton_lock" {{(pid=92840) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 30 16:04:23 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Stop services. {{(pid=92840) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 30 16:04:23 devstack cinder-volume[92840]: DEBUG oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Killing children. {{(pid=92840) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 30 16:04:23 devstack cinder-volume[92840]: INFO oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Waiting on 1 children to exit Jun 30 16:04:23 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root Jun 30 16:04:23 devstack cinder-volume[93056]: DEBUG oslo_concurrency.processutils [None req-42b3fd7d-eeca-4a7a-9c99-298db93187dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.776s {{(pid=93056) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:04:23 devstack cinder-volume[93056]: DEBUG cinder.manager [None req-42b3fd7d-eeca-4a7a-9c99-298db93187dd None None] Notifying Schedulers of capabilities ... {{(pid=93056) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:04:25 devstack cinder-volume[93056]: DEBUG oslo_concurrency.lockutils [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Acquiring lock "singleton_lock" {{(pid=93056) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 30 16:04:25 devstack cinder-volume[93056]: DEBUG oslo_concurrency.lockutils [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Acquired lock "singleton_lock" {{(pid=93056) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 30 16:04:25 devstack cinder-volume[93056]: DEBUG oslo_concurrency.lockutils [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Releasing lock "singleton_lock" {{(pid=93056) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 30 16:04:25 devstack cinder-volume[93056]: WARNING amqp [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 30 16:04:25 devstack cinder-volume[93056]: WARNING amqp [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 30 16:04:25 devstack cinder-volume[92840]: INFO oslo_service.backend._eventlet.service [None req-bce2851f-2abf-4ca7-905e-e9fb03562827 None None] Child 93056 exited with status 0 Jun 30 16:04:26 devstack cinder-volume[93473]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 30 16:04:26 devstack cinder-volume[93473]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 30 16:04:26 devstack cinder-volume[93473]: we strongly recommend against using it for new projects. Jun 30 16:04:26 devstack cinder-volume[93473]: If you are already using Eventlet, we recommend migrating to a different Jun 30 16:04:26 devstack cinder-volume[93473]: framework. For more detail see Jun 30 16:04:26 devstack cinder-volume[93473]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 30 16:04:26 devstack cinder-volume[93473]: import eventlet # noqa Jun 30 16:04:29 devstack cinder-volume[93473]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93473) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 30 16:04:29 devstack cinder-volume[93473]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93473) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 30 16:04:29 devstack cinder-volume[93473]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93473) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 30 16:04:30 devstack cinder-volume[93473]: INFO dbcounter [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] Registered counter for database cinder Jun 30 16:04:30 devstack cinder-volume[93473]: DEBUG oslo_db.sqlalchemy.engines [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93473) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 30 16:04:30 devstack cinder-volume[93473]: DEBUG dbcounter [-] [93473] Writer thread running {{(pid=93473) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 30 16:04:30 devstack cinder-volume[93473]: INFO cinder.rpc [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 30 16:04:30 devstack cinder-volume[93473]: INFO cinder.rpc [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 30 16:04:30 devstack cinder-volume[93473]: DEBUG oslo_db.sqlalchemy.engines [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93473) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 30 16:04:30 devstack cinder-volume[93473]: INFO cinder.volume.manager [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] Determined volume DB was empty at startup. Jun 30 16:04:30 devstack cinder-volume[93473]: DEBUG cinder.volume.manager [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93473) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 30 16:04:30 devstack cinder-volume[93473]: WARNING stevedore.named [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 30 16:04:30 devstack cinder-volume[93473]: WARNING castellan.key_manager [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 30 16:04:30 devstack cinder-volume[93473]: WARNING cinder.keymgr.conf_key_mgr [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 30 16:04:30 devstack cinder-volume[93473]: INFO cinder.volume.manager [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_db.sqlalchemy.engines [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93473) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 30 16:04:31 devstack cinder-volume[93473]: INFO oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] Starting 1 workers Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] Started child 93781 {{(pid=93473) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] Full set of CONF: {{(pid=93473) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] ******************************************************************************** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] Configuration options gathered from: {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] ================================================================================ {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] allow_availability_zone_fallback = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] allow_compression_on_image_upload = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] allowed_direct_url_schemes = [] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] api_rate_limit = True {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] auth_strategy = keystone {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_availability_zone = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_host = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_name = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_stats_polling_interval = 60 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backup_api_class = cinder.backup.api.API {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backup_name_template = backup-%s {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backup_use_same_host = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backup_use_temp_snapshot = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] chap_password = **** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] chap_username = {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93781]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cinder_internal_tenant_project_id = 5d0f2eac1aef438ab199043492dc050e {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cinder_internal_tenant_user_id = 733118733e104bbbbecab773ae170597 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cluster = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] compression_format = gzip {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] compute_api_class = cinder.compute.nova.API {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] config_dir = [] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] config_source = [] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] control_exchange = openstack {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] debug = True {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] default_availability_zone = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] default_group_type = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] default_volume_type = QuobyteHD {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] disk_geometry = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] driver_client_cert = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] driver_client_cert_key = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] driver_data_namespace = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] driver_ssl_cert_path = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] driver_ssl_cert_verify = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] driver_use_ssl = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] enable_new_services = True {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] enable_unsupported_driver = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] enabled_backends = ['QuobyteHD'] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] enforce_multipath_for_image_xfer = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] filter_function = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] glance_api_insecure = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] glance_api_servers = ['http://192.168.122.98/image'] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] glance_api_ssl_compression = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] glance_ca_certificates_file = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] glance_catalog_info = image:glance:publicURL {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] glance_certfile = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] glance_keyfile = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] glance_num_retries = 3 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] glance_request_timeout = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] goodness_function = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] graceful_shutdown_timeout = 5 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] group_api_class = cinder.group.api.API {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] host = devstack {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] image_compress_on_upload = True {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] image_conversion_address_space_limit = 1 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] image_conversion_cpu_limit = 60 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] image_conversion_disable = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] image_upload_use_cinder_backend = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] image_upload_use_internal_tenant = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] image_volume_cache_enabled = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] image_volume_cache_max_count = 0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] image_volume_cache_max_size_gb = 0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] init_host_max_objects_retrieval = 0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] instance_format = [instance: %(uuid)s] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] iscsi_target_flags = {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] iscsi_write_cache = on {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] iser_helper = tgtadm {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] iser_ip_address = 192.168.122.98 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] iser_port = 3260 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] log_color = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] log_config_append = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] log_dir = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] log_file = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] log_options = True {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] log_rotate_interval = 1 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] log_rotate_interval_type = days {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] log_rotation_type = none {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] max_age = 0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] max_logfile_count = 30 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] max_logfile_size_mb = 200 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] max_over_subscription_ratio = 20.0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] message_reap_interval = 86400 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] message_ttl = 2592000 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] migration_create_volume_timeout_secs = 300 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] monkey_patch = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] monkey_patch_modules = [] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] my_ip = 192.168.122.98 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] no_snapshot_gb_quota = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] num_iser_scan_tries = 3 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] num_shell_tries = 3 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] num_volume_device_scan_tries = 3 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] nvmeof_conn_info_version = 1 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] nvmet_ns_id = 10 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] nvmet_port_id = 1 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] osapi_max_limit = 1000 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] osapi_volume_ext_list = [] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] osapi_volume_listen_port = 8776 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] osapi_volume_use_ssl = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] osapi_volume_workers = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] per_volume_size_limit = -1 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] periodic_fuzzy_delay = 60 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] periodic_interval = 60 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] public_endpoint = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] publish_errors = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] quota_backup_gigabytes = 1000 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] quota_backups = 10 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] quota_gigabytes = 1000 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] quota_groups = 10 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] quota_snapshots = 10 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] quota_volumes = 10 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] rate_limit_burst = 0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] rate_limit_except_level = CRITICAL {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] rate_limit_interval = 0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] reinit_driver_count = 3 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] replication_device = **** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] report_discard_supported = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] report_interval = 120 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] reservation_clean_interval = 86400 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] reservation_expire = 86400 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] reserved_image_namespaces = [] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] reserved_percentage = 0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] rpc_response_timeout = 120 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] run_external_periodic_tasks = True {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] scst_target_driver = iscsi {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] scst_target_iqn_name = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] service_down_time = 720 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] shell_completion = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] snapshot_name_template = snapshot-%s {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] split_loggers = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] state_path = /opt/stack/data/cinder {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] storage_availability_zone = nova {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] storage_protocol = iSCSI {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] syslog_log_facility = LOG_USER {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] target_helper = lioadm {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] target_ip_address = 192.168.122.98 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] target_port = 3260 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] target_protocol = iscsi {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] target_secondary_ip_addresses = [] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] trace_flags = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] transport_url = **** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] until_refresh = 0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] use_chap_auth = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] use_default_quota_class = True {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] use_journal = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] use_json = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] use_multipath_for_image_xfer = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] use_stderr = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] use_syslog = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] verify_glance_signatures = enabled {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] volume_api_class = cinder.volume.api.API {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] volume_backend_name = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] volume_clear = zero {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] volume_clear_ionice = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] volume_clear_size = 0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] volume_copy_bps_limit = 0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] volume_dd_blocksize = 1M {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] volume_name_template = volume-%s {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] volume_service_inithost_offload = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] volume_usage_audit_period = month {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] zoning_mode = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_concurrency.disable_process_locking = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.auth_section = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.auth_type = password {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.auth_version = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.cache = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.certfile = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93781) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.include_service_catalog = True {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.insecure = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.interface = public {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.keyfile = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.memcache_password = {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.memcache_username = {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.region_name = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.service_type = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.98/identity {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.backend = dogpile.cache.null {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.backend_argument = **** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.backend_expiration_time = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.config_prefix = cache.oslo {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.debug_cache_backend = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.enable_retry_client = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.enable_socket_keepalive = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.enabled = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.expiration_time = 600 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.hashclient_retry_attempts = 2 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.memcache_dead_retry = 300 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.memcache_pool_maxsize = 10 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.memcache_sasl_enabled = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.password = **** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.proxies = [] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.redis_db = 0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.redis_server = localhost:6379 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.retry_attempts = 2 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.retry_delay = 0.0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.socket_keepalive_count = 1 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.socket_keepalive_idle = 1 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.socket_keepalive_interval = 1 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.socket_timeout = 1.0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.tls_allowed_ciphers = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.tls_cafile = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.tls_certfile = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.tls_enabled = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.tls_keyfile = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cache.username = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] coordination.backend_url = **** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] database.asyncio_connection = **** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] database.asyncio_slave_connection = **** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] database.backend = sqlalchemy {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] database.connection = **** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] database.connection_debug = 0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] database.connection_parameters = {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] database.connection_recycle_time = 3600 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] database.connection_trace = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] database.db_inc_retry_interval = True {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] database.db_max_retries = 20 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] database.db_max_retry_interval = 10 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] database.db_retry_interval = 1 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] database.max_overflow = 50 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] database.max_pool_size = 5 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] database.max_retries = 10 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] database.mysql_wsrep_sync_wait = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] database.pool_timeout = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] database.retry_interval = 10 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] database.slave_connection = **** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] database.sqlite_synchronous = True {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] database.synchronous_reader = True {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] database.use_db_reconnect = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] profiler.connection_string = messaging:// {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] profiler.enabled = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] profiler.es_doc_type = notification {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] profiler.es_scroll_size = 10000 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] profiler.es_scroll_time = 2m {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] profiler.filter_error_trace = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] profiler.hmac_keys = **** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] profiler.sentinel_service_name = mymaster {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] profiler.socket_timeout = 0.1 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] profiler.trace_requests = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] profiler.trace_sqlalchemy = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] profiler_jaeger.process_tags = {} {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] profiler_jaeger.service_name_prefix = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] profiler_otlp.service_name_prefix = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_policy.enforce_new_defaults = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: WARNING oslo_config.cfg [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_policy.enforce_scope = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_policy.policy_default_rule = default {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_policy.policy_file = policy.yaml {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] privsep_osbrick.group = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] privsep_osbrick.helper_command = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] privsep_osbrick.user = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cinder_sys_admin.group = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cinder_sys_admin.helper_command = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] cinder_sys_admin.user = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] service_user.auth_section = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] service_user.auth_type = password {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] service_user.cafile = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] service_user.certfile = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] service_user.collect_timing = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] service_user.insecure = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] service_user.keyfile = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] service_user.send_service_user_token = True {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] service_user.split_loggers = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] service_user.timeout = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] glance.auth_section = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] glance.auth_type = password {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] glance.certfile = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] glance.collect_timing = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] glance.insecure = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] glance.keyfile = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] glance.region_name = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] glance.split_loggers = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] glance.timeout = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.backend_availability_zone = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.chap_password = **** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.chap_username = {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.disk_geometry = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.driver_client_cert = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.driver_client_cert_key = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.driver_data_namespace = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.driver_use_ssl = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.extra_capabilities = {} {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.filter_function = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.goodness_function = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.iscsi_target_flags = {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.iscsi_write_cache = on {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.iser_helper = tgtadm {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.iser_ip_address = 192.168.122.98 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.iser_port = 3260 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.nas_host = {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.nas_login = admin {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.nas_mount_options = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.nas_password = **** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.nas_private_key = {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.nas_share_path = {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.num_shell_tries = 3 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.quobyte_volume_url = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.replication_device = **** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.report_discard_supported = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.reserved_percentage = 0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.target_helper = tgtadm {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.target_ip_address = 192.168.122.98 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.target_port = 3260 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.target_protocol = iscsi {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.trace_flags = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.unique_fqdn_network = True {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.use_chap_auth = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.volume_backend_name = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.volume_clear = zero {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.volume_clear_ionice = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.volume_clear_size = 0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_reports.file_event_handler = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_reports.log_dir = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.backend_availability_zone = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.backend_host = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.chap_password = **** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.chap_username = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.chiscsi_conf = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.disk_geometry = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.driver_client_cert = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.driver_data_namespace = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.driver_use_ssl = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.extra_capabilities = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.filter_function = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.goodness_function = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.iser_helper = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.iser_ip_address = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.iser_port = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.iser_target_prefix = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93781) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 30 16:04:31 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.quobyte [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 30 16:04:31 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.quobyte [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.nas_host = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.nas_login = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.nas_mount_options = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.nas_password = **** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.nas_private_key = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.nas_share_path = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.nas_ssh_port = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.num_shell_tries = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.nvmet_port_id = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.replication_device = **** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.report_discard_supported = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Running cmd (subprocess): mount.quobyte {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.reserved_percentage = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.scst_target_driver = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.storage_protocol = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.target_helper = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.target_ip_address = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.target_port = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.target_prefix = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.target_protocol = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.trace_flags = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.use_chap_auth = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.volume_clear = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.volume_clear_size = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] QuobyteHD.volumes_dir = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.ssl = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_notifications.driver = [] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_notifications.retry = -1 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] key_manager.fixed_key = **** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican.barbican_api_version = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican.barbican_endpoint = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican.barbican_endpoint_type = public {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican.barbican_region_name = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican.cafile = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican.certfile = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican.collect_timing = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican.insecure = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican.keyfile = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican.number_of_retries = 60 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican.retry_delay = 1 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican.send_service_user_token = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican.split_loggers = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican.timeout = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican.verify_ssl = True {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican.verify_ssl_path = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican_service_user.auth_section = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican_service_user.auth_type = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican_service_user.cafile = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican_service_user.certfile = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican_service_user.collect_timing = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican_service_user.insecure = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican_service_user.keyfile = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican_service_user.split_loggers = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] barbican_service_user.timeout = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] vault.approle_role_id = **** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] vault.approle_secret_id = **** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] vault.kv_mountpoint = secret {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] vault.kv_path = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] vault.kv_version = 2 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] vault.namespace = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] vault.root_token_id = **** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] vault.ssl_ca_crt_file = None {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] vault.timeout = 60.0 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] vault.use_ssl = False {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 30 16:04:31 devstack cinder-volume[93473]: DEBUG oslo_service.backend._eventlet.service [None req-f6b9e9d1-8508-4bed-aacc-5e131fe06372 None None] ******************************************************************************** {{(pid=93473) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 30 16:04:31 devstack quobyte-client[93790]: Reading configuration file: /etc/quobyte/client.cfg Jun 30 16:04:31 devstack quobyte-client[93790]: Invalid parameters found, error: missing mount point. Jun 30 16:04:31 devstack quobyte-client[93790]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 30 16:04:31 devstack quobyte-client[93790]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 30 16:04:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] CMD "mount.quobyte" returned: 1 in 0.142s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:04:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:04:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:04:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:04:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:04:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:04:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:04:31 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:04:31 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:04:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.840s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:04:32 devstack cinder-volume[93781]: INFO cinder.volume.driver [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Driver hasn't implemented _init_vendor_properties() Jun 30 16:04:32 devstack cinder-volume[93781]: DEBUG cinder.volume.driver [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576904296875, 'free_capacity_gb': 1775.7576904296875, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93781) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 30 16:04:32 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Jun 30 16:04:32 devstack cinder-volume[93781]: DEBUG oslo_db.sqlalchemy.engines [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93781) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 30 16:04:32 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writer thread running {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 30 16:04:32 devstack cinder-volume[93781]: DEBUG cinder.db.api [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Building query based on filter {{(pid=93781) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 30 16:04:32 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93781) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 30 16:04:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:04:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:04:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:04:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:04:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:04:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:04:32 devstack cinder-volume[93781]: INFO cinder.keymgr.migration [None req-8d12ae96-be24-464e-b9df-4d28b0919ca3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 30 16:04:32 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:04:32 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:04:33 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Jun 30 16:04:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.679s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:04:33 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:04:33 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Driver initialization completed successfully. Jun 30 16:04:33 devstack cinder-volume[93781]: INFO cinder.manager [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Initiating service 3 cleanup Jun 30 16:04:33 devstack cinder-volume[93781]: INFO cinder.manager [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Service 3 cleanup completed. Jun 30 16:04:33 devstack cinder-volume[93781]: DEBUG cinder.service [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Creating RPC server for service cinder-volume {{(pid=93781) start /opt/stack/cinder/cinder/service.py:231}} Jun 30 16:04:33 devstack cinder-volume[93781]: DEBUG cinder.service [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93781) start /opt/stack/cinder/cinder/service.py:237}} Jun 30 16:04:33 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 30 16:04:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:04:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:04:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:04:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:04:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:04:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:04:33 devstack sudo[93806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:04:33 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:04:33 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root Jun 30 16:04:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.615s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:04:33 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-f4dca552-c892-49b6-8199-785b92de5c73 None None] Driver post RPC initialization completed successfully. Jun 30 16:04:41 devstack cinder-volume[93473]: DEBUG dbcounter [-] [93473] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93473) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:04:43 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:04:43 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=4 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:05:30 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:05:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Flow 'volume_create_manager' (47a59be9-794b-4b83-8b47-b260ae740739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:05:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc08f0d9-8880-4f30-9734-a5e9f9be8c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:05:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc08f0d9-8880-4f30-9734-a5e9f9be8c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-12680417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57254cc6-9300-4f55-bc61-c35956bae994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3360ce0009f447b3aa1c2637827eb753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:05:31Z,use_quota=True,user_id='198a0c19fe814d3fbd194056c2c87913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:05:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf18458-f486-4b07-872c-c2b293027597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:05:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf18458-f486-4b07-872c-c2b293027597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:05:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d22237-7d98-4596-bc38-450d2383e4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:05:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d22237-7d98-4596-bc38-450d2383e4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57254cc6-9300-4f55-bc61-c35956bae994', 'volume_name': 'volume-57254cc6-9300-4f55-bc61-c35956bae994', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:05:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbf6147-d699-4c7a-b33b-c7b06618bd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:05:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbf6147-d699-4c7a-b33b-c7b06618bd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:05:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (488e4b35-accd-4cce-9bcf-69a74756c2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:05:30 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Volume 57254cc6-9300-4f55-bc61-c35956bae994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57254cc6-9300-4f55-bc61-c35956bae994', 'volume_size': 1} Jun 30 16:05:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:05:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:05:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-12680417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57254cc6-9300-4f55-bc61-c35956bae994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3360ce0009f447b3aa1c2637827eb753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:05:31Z,use_quota=True,user_id='198a0c19fe814d3fbd194056c2c87913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:05:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Creating volume 57254cc6-9300-4f55-bc61-c35956bae994 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:05:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:05:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:05:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:05:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:05:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:05:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:05:31 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:05:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-57254cc6-9300-4f55-bc61-c35956bae994 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:05:31 devstack sudo[94170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-57254cc6-9300-4f55-bc61-c35956bae994 1073741824 Jun 30 16:05:31 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:05:31 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:05:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Flow 'volume_create_manager' (48d1908b-db43-4586-886e-5cb9a965fd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:05:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08915d93-45d1-4a49-ba6e-86a4f10fd3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:05:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08915d93-45d1-4a49-ba6e-86a4f10fd3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1154395691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dffb2098-87ad-4e4f-97cc-e43a0b46076c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56ea5dc568394437afa90bee89e7f526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:05:31Z,use_quota=True,user_id='90468a0b5fbc49a7baa538d441cb9ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:05:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf07450-d51f-49ca-9b95-590ddecc7439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:05:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf07450-d51f-49ca-9b95-590ddecc7439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:05:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ebda73-85a0-49f3-8e66-47e3a2607515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:05:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ebda73-85a0-49f3-8e66-47e3a2607515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dffb2098-87ad-4e4f-97cc-e43a0b46076c', 'volume_name': 'volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:05:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d048a05-ce07-4b7b-9151-703ee81db899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:05:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d048a05-ce07-4b7b-9151-703ee81db899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:05:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9668f538-bc29-45c1-8abe-ddb90c227162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:05:31 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Volume dffb2098-87ad-4e4f-97cc-e43a0b46076c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c', 'volume_size': 1} Jun 30 16:05:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:05:32 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root Jun 30 16:05:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-57254cc6-9300-4f55-bc61-c35956bae994 1073741824" returned: 0 in 1.042s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:05:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-57254cc6-9300-4f55-bc61-c35956bae994 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:05:32 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-57254cc6-9300-4f55-bc61-c35956bae994 Jun 30 16:05:32 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:05:32 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Jun 30 16:05:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-57254cc6-9300-4f55-bc61-c35956bae994" returned: 0 in 0.701s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:05:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:05:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:05:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.400s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:05:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1154395691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dffb2098-87ad-4e4f-97cc-e43a0b46076c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56ea5dc568394437afa90bee89e7f526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:05:31Z,use_quota=True,user_id='90468a0b5fbc49a7baa538d441cb9ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:05:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Creating volume dffb2098-87ad-4e4f-97cc-e43a0b46076c {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:05:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:05:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:05:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:05:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:05:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:05:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:05:32 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:05:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:05:32 devstack sudo[94498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c 1073741824 Jun 30 16:05:32 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:05:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (488e4b35-accd-4cce-9bcf-69a74756c2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57254cc6-9300-4f55-bc61-c35956bae994', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:05:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0f9ff1-e323-4e88-ac60-0c22152fabe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:05:32 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Volume volume-57254cc6-9300-4f55-bc61-c35956bae994 (57254cc6-9300-4f55-bc61-c35956bae994): created successfully Jun 30 16:05:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0f9ff1-e323-4e88-ac60-0c22152fabe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:05:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Flow 'volume_create_manager' (47a59be9-794b-4b83-8b47-b260ae740739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:05:32 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:05:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:05:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:05:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:05:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:05:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:05:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:05:33 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-09867178-1679-4684-bc22-24843a95af67 tempest-TaggedAttachmentsTest-1608795194 None] Created volume successfully. Jun 30 16:05:33 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:05:33 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:05:34 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Jun 30 16:05:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.184s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:05:34 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:05:34 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:05:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 6 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:05:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:05:34 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root Jun 30 16:05:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c 1073741824" returned: 0 in 1.471s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:05:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:05:34 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c Jun 30 16:05:34 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:05:35 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Jun 30 16:05:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c" returned: 0 in 0.867s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:05:35 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] <== create_volume: return (2434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:05:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.437s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:05:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9668f538-bc29-45c1-8abe-ddb90c227162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:05:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a0caca-c94e-4b9f-9a76-fa005ad22891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:05:35 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Volume volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c (dffb2098-87ad-4e4f-97cc-e43a0b46076c): created successfully Jun 30 16:05:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7a0caca-c94e-4b9f-9a76-fa005ad22891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:05:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Flow 'volume_create_manager' (48d1908b-db43-4586-886e-5cb9a965fd97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:05:35 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-6e51667a-106a-4632-ade3-21ff90d14613 req-7742ccce-ceaf-4ce0-800a-b89dd7bba4d2 tempest-VolumesSnapshotsTestJSON-563659706 None] Created volume successfully. Jun 30 16:05:36 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:05:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Flow 'volume_create_manager' (adbff7c3-15df-4a0f-989c-6740914ee773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:05:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c72d47-aaa4-472c-9480-6de6b7e3254c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:05:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c72d47-aaa4-472c-9480-6de6b7e3254c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1145996557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb58630-f282-452f-a235-8ba950dceb54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835bb125fb3f418bb99676a750327ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:05:37Z,use_quota=True,user_id='03e71cd12660411d868b352fbdc1988d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:05:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a54ea8a-7e09-409a-8788-42d182a7c146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:05:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a54ea8a-7e09-409a-8788-42d182a7c146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:05:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6b7830-a840-4ce4-b8d1-817e66b5fb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:05:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6b7830-a840-4ce4-b8d1-817e66b5fb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeb58630-f282-452f-a235-8ba950dceb54', 'volume_name': 'volume-aeb58630-f282-452f-a235-8ba950dceb54', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:05:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c1f0f8-7a2b-4820-b9b6-3405b7700010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:05:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c1f0f8-7a2b-4820-b9b6-3405b7700010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:05:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1653f580-3847-4bfc-b0f7-2b79e223d7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:05:36 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Volume aeb58630-f282-452f-a235-8ba950dceb54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeb58630-f282-452f-a235-8ba950dceb54', 'volume_size': 1} Jun 30 16:05:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:05:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:05:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1145996557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb58630-f282-452f-a235-8ba950dceb54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835bb125fb3f418bb99676a750327ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:05:37Z,use_quota=True,user_id='03e71cd12660411d868b352fbdc1988d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:05:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Creating volume aeb58630-f282-452f-a235-8ba950dceb54 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:05:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:05:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:05:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:05:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:05:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:05:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:05:36 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:05:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-aeb58630-f282-452f-a235-8ba950dceb54 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:05:36 devstack sudo[94520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-aeb58630-f282-452f-a235-8ba950dceb54 1073741824 Jun 30 16:05:36 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:05:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-6d1659f5-4c4f-4cee-917c-f993b1d7dc54 req-81256cc6-e7e2-4ab1-b99d-20971c3dcd31 tempest-VolumesSnapshotsTestJSON-563659706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:05:38 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root Jun 30 16:05:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-aeb58630-f282-452f-a235-8ba950dceb54 1073741824" returned: 0 in 1.334s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:05:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-aeb58630-f282-452f-a235-8ba950dceb54 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:05:38 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-aeb58630-f282-452f-a235-8ba950dceb54 Jun 30 16:05:38 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:05:39 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Jun 30 16:05:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-aeb58630-f282-452f-a235-8ba950dceb54" returned: 0 in 0.937s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:05:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] <== create_volume: return (2325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:05:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.328s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:05:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-6d1659f5-4c4f-4cee-917c-f993b1d7dc54 req-81256cc6-e7e2-4ab1-b99d-20971c3dcd31 tempest-VolumesSnapshotsTestJSON-563659706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.978s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:05:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1653f580-3847-4bfc-b0f7-2b79e223d7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeb58630-f282-452f-a235-8ba950dceb54', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:05:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5fd9e5a-23f1-4552-949c-8ce79488006d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:05:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [req-6d1659f5-4c4f-4cee-917c-f993b1d7dc54 req-81256cc6-e7e2-4ab1-b99d-20971c3dcd31 tempest-VolumesSnapshotsTestJSON-563659706 None] Creating offline snapshot 9615ed0f-4872-4d46-9116-28393ebc2b2f of volume dffb2098-87ad-4e4f-97cc-e43a0b46076c {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:05:39 devstack cinder-volume[93781]: INFO oslo.privsep.daemon [req-6d1659f5-4c4f-4cee-917c-f993b1d7dc54 req-81256cc6-e7e2-4ab1-b99d-20971c3dcd31 tempest-VolumesSnapshotsTestJSON-563659706 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpe9bgmezc/privsep.sock'] Jun 30 16:05:39 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpe9bgmezc/privsep.sock Jun 30 16:05:39 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:05:39 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Volume volume-aeb58630-f282-452f-a235-8ba950dceb54 (aeb58630-f282-452f-a235-8ba950dceb54): created successfully Jun 30 16:05:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5fd9e5a-23f1-4552-949c-8ce79488006d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:05:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Flow 'volume_create_manager' (adbff7c3-15df-4a0f-989c-6740914ee773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:05:39 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-c3d20f62-0850-46b6-8b7e-4ce8fab6f455 tempest-DeleteServersTestJSON-1473887185 None] Created volume successfully. Jun 30 16:05:39 devstack cinder-volume[93781]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 30 16:05:39 devstack cinder-volume[93781]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 30 16:05:39 devstack cinder-volume[93781]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 30 16:05:39 devstack cinder-volume[93781]: WARNING oslo.privsep.daemon [-] privsep log: Jun 30 16:05:39 devstack cinder-volume[93781]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 30 16:05:39 devstack cinder-volume[93781]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 30 16:05:39 devstack cinder-volume[93781]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 30 16:05:39 devstack cinder-volume[93781]: WARNING oslo.privsep.daemon [-] privsep log: Jun 30 16:05:39 devstack cinder-volume[93781]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 30 16:05:40 devstack cinder-volume[93781]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 30 16:05:40 devstack cinder-volume[93781]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 30 16:05:40 devstack cinder-volume[93781]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 30 16:05:40 devstack cinder-volume[93781]: WARNING oslo.privsep.daemon [-] privsep log: Jun 30 16:05:40 devstack cinder-volume[93781]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 30 16:05:40 devstack cinder-volume[93781]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 30 16:05:40 devstack cinder-volume[93781]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 30 16:05:40 devstack cinder-volume[93781]: WARNING oslo.privsep.daemon [-] privsep log: Jun 30 16:05:40 devstack cinder-volume[93781]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 30 16:05:41 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Jun 30 16:05:41 devstack cinder-volume[93781]: INFO oslo.privsep.daemon [req-6d1659f5-4c4f-4cee-917c-f993b1d7dc54 req-81256cc6-e7e2-4ab1-b99d-20971c3dcd31 tempest-VolumesSnapshotsTestJSON-563659706 None] Spawned new privsep daemon via rootwrap Jun 30 16:05:41 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [req-6d1659f5-4c4f-4cee-917c-f993b1d7dc54 req-81256cc6-e7e2-4ab1-b99d-20971c3dcd31 tempest-VolumesSnapshotsTestJSON-563659706 None] Accepted privsep connection to /tmp/tmpe9bgmezc/privsep.sock {{(pid=93781) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 30 16:05:41 devstack cinder-volume[93781]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 30 16:05:41 devstack cinder-volume[93781]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 30 16:05:41 devstack cinder-volume[93781]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 30 16:05:41 devstack cinder-volume[93781]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94559 Jun 30 16:05:41 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[883260f4-1269-465f-bf15-f851c90ecd9d]: (2,) {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:05:41 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c487605-89a2-4a45-8572-18c0dd05501d]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:05:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-6d1659f5-4c4f-4cee-917c-f993b1d7dc54 req-81256cc6-e7e2-4ab1-b99d-20971c3dcd31 tempest-VolumesSnapshotsTestJSON-563659706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:05:41 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c Jun 30 16:05:41 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:05:42 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Jun 30 16:05:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-6d1659f5-4c4f-4cee-917c-f993b1d7dc54 req-81256cc6-e7e2-4ab1-b99d-20971c3dcd31 tempest-VolumesSnapshotsTestJSON-563659706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c" returned: 0 in 0.987s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:05:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-6d1659f5-4c4f-4cee-917c-f993b1d7dc54 req-81256cc6-e7e2-4ab1-b99d-20971c3dcd31 tempest-VolumesSnapshotsTestJSON-563659706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.9615ed0f-4872-4d46-9116-28393ebc2b2f 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:05:42 devstack sudo[94579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.9615ed0f-4872-4d46-9116-28393ebc2b2f 1G Jun 30 16:05:42 devstack sudo[94579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:05:43 devstack sudo[94579]: pam_unix(sudo:session): session closed for user root Jun 30 16:05:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-6d1659f5-4c4f-4cee-917c-f993b1d7dc54 req-81256cc6-e7e2-4ab1-b99d-20971c3dcd31 tempest-VolumesSnapshotsTestJSON-563659706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.9615ed0f-4872-4d46-9116-28393ebc2b2f 1G" returned: 0 in 1.231s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:05:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-6d1659f5-4c4f-4cee-917c-f993b1d7dc54 req-81256cc6-e7e2-4ab1-b99d-20971c3dcd31 tempest-VolumesSnapshotsTestJSON-563659706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.9615ed0f-4872-4d46-9116-28393ebc2b2f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:05:43 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.9615ed0f-4872-4d46-9116-28393ebc2b2f Jun 30 16:05:43 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:05:44 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Jun 30 16:05:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-6d1659f5-4c4f-4cee-917c-f993b1d7dc54 req-81256cc6-e7e2-4ab1-b99d-20971c3dcd31 tempest-VolumesSnapshotsTestJSON-563659706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.9615ed0f-4872-4d46-9116-28393ebc2b2f" returned: 0 in 1.019s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:05:44 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [req-6d1659f5-4c4f-4cee-917c-f993b1d7dc54 req-81256cc6-e7e2-4ab1-b99d-20971c3dcd31 tempest-VolumesSnapshotsTestJSON-563659706 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.9615ed0f-4872-4d46-9116-28393ebc2b2f is being set with open permissions: ugo+rw Jun 30 16:05:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-6d1659f5-4c4f-4cee-917c-f993b1d7dc54 req-81256cc6-e7e2-4ab1-b99d-20971c3dcd31 tempest-VolumesSnapshotsTestJSON-563659706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.9615ed0f-4872-4d46-9116-28393ebc2b2f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:05:44 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.9615ed0f-4872-4d46-9116-28393ebc2b2f Jun 30 16:05:44 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:05:45 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Jun 30 16:05:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-6d1659f5-4c4f-4cee-917c-f993b1d7dc54 req-81256cc6-e7e2-4ab1-b99d-20971c3dcd31 tempest-VolumesSnapshotsTestJSON-563659706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.9615ed0f-4872-4d46-9116-28393ebc2b2f" returned: 0 in 1.003s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:05:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-6d1659f5-4c4f-4cee-917c-f993b1d7dc54 req-81256cc6-e7e2-4ab1-b99d-20971c3dcd31 tempest-VolumesSnapshotsTestJSON-563659706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:05:45 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.info Jun 30 16:05:45 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:05:47 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Jun 30 16:05:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-6d1659f5-4c4f-4cee-917c-f993b1d7dc54 req-81256cc6-e7e2-4ab1-b99d-20971c3dcd31 tempest-VolumesSnapshotsTestJSON-563659706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.info" returned: 0 in 1.538s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:05:47 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [req-6d1659f5-4c4f-4cee-917c-f993b1d7dc54 req-81256cc6-e7e2-4ab1-b99d-20971c3dcd31 tempest-VolumesSnapshotsTestJSON-563659706 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.info is being set with open permissions: ugo+rw Jun 30 16:05:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-6d1659f5-4c4f-4cee-917c-f993b1d7dc54 req-81256cc6-e7e2-4ab1-b99d-20971c3dcd31 tempest-VolumesSnapshotsTestJSON-563659706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:05:47 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.info Jun 30 16:05:47 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:05:47 devstack cinder-volume[93781]: WARNING py.warnings [req-f446217f-7178-4ee9-a4ad-5481d26fc059 req-de9ea2bd-0f39-467e-8d21-75a648220154 tempest-DeleteServersTestJSON-1473887185 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jun 30 16:05:47 devstack cinder-volume[93781]: .first() Jun 30 16:05:47 devstack cinder-volume[93781]: Jun 30 16:05:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-f446217f-7178-4ee9-a4ad-5481d26fc059 req-de9ea2bd-0f39-467e-8d21-75a648220154 tempest-DeleteServersTestJSON-1473887185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:05:48 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Jun 30 16:05:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-6d1659f5-4c4f-4cee-917c-f993b1d7dc54 req-81256cc6-e7e2-4ab1-b99d-20971c3dcd31 tempest-VolumesSnapshotsTestJSON-563659706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.info" returned: 0 in 1.138s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:05:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-6d1659f5-4c4f-4cee-917c-f993b1d7dc54 req-81256cc6-e7e2-4ab1-b99d-20971c3dcd31 tempest-VolumesSnapshotsTestJSON-563659706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.212s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:05:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-f446217f-7178-4ee9-a4ad-5481d26fc059 req-de9ea2bd-0f39-467e-8d21-75a648220154 tempest-DeleteServersTestJSON-1473887185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.698s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:05:48 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[1960f68a-1e79-4ea5-90c0-8d507e959868]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:05:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-f446217f-7178-4ee9-a4ad-5481d26fc059 req-de9ea2bd-0f39-467e-8d21-75a648220154 tempest-DeleteServersTestJSON-1473887185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-aeb58630-f282-452f-a235-8ba950dceb54 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:05:48 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-6d1659f5-4c4f-4cee-917c-f993b1d7dc54 req-81256cc6-e7e2-4ab1-b99d-20971c3dcd31 tempest-VolumesSnapshotsTestJSON-563659706 None] Create snapshot completed successfully Jun 30 16:05:48 devstack sudo[94668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-aeb58630-f282-452f-a235-8ba950dceb54 Jun 30 16:05:48 devstack sudo[94668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:05:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] Acquiring lock "cinder-9615ed0f-4872-4d46-9116-28393ebc2b2f-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:05:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] Lock "cinder-9615ed0f-4872-4d46-9116-28393ebc2b2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:05:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] Acquiring lock "cinder-quobyte-dffb2098-87ad-4e4f-97cc-e43a0b46076c" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:05:49 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] Lock "cinder-quobyte-dffb2098-87ad-4e4f-97cc-e43a0b46076c" acquired by "delete_snapshot" :: waited 0.043s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:05:49 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] Acquiring lock "cinder-quobyte-9615ed0f-4872-4d46-9116-28393ebc2b2f" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:05:49 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] Lock "cinder-quobyte-9615ed0f-4872-4d46-9116-28393ebc2b2f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:05:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] Deleting offline snapshot 9615ed0f-4872-4d46-9116-28393ebc2b2f of volume dffb2098-87ad-4e4f-97cc-e43a0b46076c {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:05:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] snapshot_file for this snap is: volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.9615ed0f-4872-4d46-9116-28393ebc2b2f {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:05:49 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfb4e13-2d74-4906-8e9c-97d8e35c0512]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:05:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.9615ed0f-4872-4d46-9116-28393ebc2b2f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:05:49 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.9615ed0f-4872-4d46-9116-28393ebc2b2f Jun 30 16:05:49 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:05:49 devstack sudo[94668]: pam_unix(sudo:session): session closed for user root Jun 30 16:05:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-f446217f-7178-4ee9-a4ad-5481d26fc059 req-de9ea2bd-0f39-467e-8d21-75a648220154 tempest-DeleteServersTestJSON-1473887185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-aeb58630-f282-452f-a235-8ba950dceb54" returned: 0 in 1.075s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:05:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-f446217f-7178-4ee9-a4ad-5481d26fc059 req-de9ea2bd-0f39-467e-8d21-75a648220154 tempest-DeleteServersTestJSON-1473887185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.115s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:05:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-f446217f-7178-4ee9-a4ad-5481d26fc059 req-de9ea2bd-0f39-467e-8d21-75a648220154 tempest-DeleteServersTestJSON-1473887185 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a', 'name': 'volume-aeb58630-f282-452f-a235-8ba950dceb54', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2378416-3191-4ad7-bc82-c1bf227feceb', 'enforce_multipath': True} {{(pid=93781) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 30 16:05:49 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-f446217f-7178-4ee9-a4ad-5481d26fc059 req-de9ea2bd-0f39-467e-8d21-75a648220154 tempest-DeleteServersTestJSON-1473887185 None] attachment_update completed successfully. Jun 30 16:05:49 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Jun 30 16:05:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.9615ed0f-4872-4d46-9116-28393ebc2b2f" returned: 0 in 0.865s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:05:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:05:50 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fec6ba6-64ea-4cc7-ae91-df7cdf5d733f]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:05:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:05:50 devstack sudo[94695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c Jun 30 16:05:50 devstack sudo[94695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:05:50 devstack sudo[94695]: pam_unix(sudo:session): session closed for user root Jun 30 16:05:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c" returned: 0 in 0.937s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:05:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.9615ed0f-4872-4d46-9116-28393ebc2b2f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:05:50 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.9615ed0f-4872-4d46-9116-28393ebc2b2f Jun 30 16:05:50 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:05:51 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Jun 30 16:05:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.9615ed0f-4872-4d46-9116-28393ebc2b2f" returned: 0 in 0.915s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:05:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.9615ed0f-4872-4d46-9116-28393ebc2b2f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:05:51 devstack sudo[95099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.9615ed0f-4872-4d46-9116-28393ebc2b2f Jun 30 16:05:51 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:05:52 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root Jun 30 16:05:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c.9615ed0f-4872-4d46-9116-28393ebc2b2f" returned: 0 in 0.775s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:05:52 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] Lock "cinder-quobyte-9615ed0f-4872-4d46-9116-28393ebc2b2f" released by "_delete_snapshot" :: held 3.679s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:05:52 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] Lock "cinder-quobyte-dffb2098-87ad-4e4f-97cc-e43a0b46076c" released by "delete_snapshot" :: held 3.717s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:05:52 devstack cinder-volume[93781]: WARNING cinder.quota [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:05:52 devstack cinder-volume[93781]: WARNING cinder.quota [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:05:52 devstack cinder-volume[93781]: DEBUG cinder.quota [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] Created reservations ['a284fb94-7d44-4058-a243-76c848acda12', '3263b24f-1560-4524-92ee-c1e05f1b279e', 'dcf64c8e-774d-4dc3-ac5f-579a6deaed3e', 'a2a32de1-5e1a-42e3-b49d-2f434f23bdaa'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:05:52 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] Delete snapshot completed successfully. Jun 30 16:05:52 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-e6b1afef-9aab-4bab-8255-fb1e6029ad9f req-edcc1469-9e33-410a-b093-4ceda4b66056 tempest-VolumesSnapshotsTestJSON-563659706 None] Lock "cinder-9615ed0f-4872-4d46-9116-28393ebc2b2f-delete_snapshot" released by "delete_snapshot" :: held 3.986s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:05:53 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-7867eb9a-ec6d-4c02-8b1b-0ae8c787ff97 req-c3306b0e-912b-451f-b3e1-dc37dd5bc767 tempest-VolumesSnapshotsTestJSON-563659706 None] Acquiring lock "cinder-dffb2098-87ad-4e4f-97cc-e43a0b46076c-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:05:53 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-7867eb9a-ec6d-4c02-8b1b-0ae8c787ff97 req-c3306b0e-912b-451f-b3e1-dc37dd5bc767 tempest-VolumesSnapshotsTestJSON-563659706 None] Lock "cinder-dffb2098-87ad-4e4f-97cc-e43a0b46076c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:05:53 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-7867eb9a-ec6d-4c02-8b1b-0ae8c787ff97 req-c3306b0e-912b-451f-b3e1-dc37dd5bc767 tempest-VolumesSnapshotsTestJSON-563659706 None] Acquiring lock "cinder-quobyte-dffb2098-87ad-4e4f-97cc-e43a0b46076c" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:05:53 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-7867eb9a-ec6d-4c02-8b1b-0ae8c787ff97 req-c3306b0e-912b-451f-b3e1-dc37dd5bc767 tempest-VolumesSnapshotsTestJSON-563659706 None] Lock "cinder-quobyte-dffb2098-87ad-4e4f-97cc-e43a0b46076c" acquired by "delete_volume" :: waited 0.021s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:05:53 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8117dc-c59d-4c9f-94c6-e866112bc562]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:05:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-7867eb9a-ec6d-4c02-8b1b-0ae8c787ff97 req-c3306b0e-912b-451f-b3e1-dc37dd5bc767 tempest-VolumesSnapshotsTestJSON-563659706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:05:53 devstack sudo[95108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c Jun 30 16:05:53 devstack sudo[95108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:05:54 devstack sudo[95108]: pam_unix(sudo:session): session closed for user root Jun 30 16:05:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-7867eb9a-ec6d-4c02-8b1b-0ae8c787ff97 req-c3306b0e-912b-451f-b3e1-dc37dd5bc767 tempest-VolumesSnapshotsTestJSON-563659706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c" returned: 0 in 1.001s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:05:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-7867eb9a-ec6d-4c02-8b1b-0ae8c787ff97 req-c3306b0e-912b-451f-b3e1-dc37dd5bc767 tempest-VolumesSnapshotsTestJSON-563659706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:05:54 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c Jun 30 16:05:54 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:05:55 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Jun 30 16:05:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-7867eb9a-ec6d-4c02-8b1b-0ae8c787ff97 req-c3306b0e-912b-451f-b3e1-dc37dd5bc767 tempest-VolumesSnapshotsTestJSON-563659706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dffb2098-87ad-4e4f-97cc-e43a0b46076c" returned: 0 in 1.063s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:05:55 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-7867eb9a-ec6d-4c02-8b1b-0ae8c787ff97 req-c3306b0e-912b-451f-b3e1-dc37dd5bc767 tempest-VolumesSnapshotsTestJSON-563659706 None] Lock "cinder-quobyte-dffb2098-87ad-4e4f-97cc-e43a0b46076c" released by "delete_volume" :: held 2.171s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:05:55 devstack cinder-volume[93781]: WARNING cinder.quota [req-7867eb9a-ec6d-4c02-8b1b-0ae8c787ff97 req-c3306b0e-912b-451f-b3e1-dc37dd5bc767 tempest-VolumesSnapshotsTestJSON-563659706 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:05:55 devstack cinder-volume[93781]: DEBUG cinder.quota [req-7867eb9a-ec6d-4c02-8b1b-0ae8c787ff97 req-c3306b0e-912b-451f-b3e1-dc37dd5bc767 tempest-VolumesSnapshotsTestJSON-563659706 None] Created reservations ['0f3c9f10-f287-4205-b5ce-4e0e67b9baa6', 'a3b872e3-a682-406a-9ea7-a8f4a12ce093', 'f70b391e-917c-4ee9-94b2-a5022a6229b6', '9b0b1030-77fa-40e0-a602-c2f01031d44c'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:05:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-7867eb9a-ec6d-4c02-8b1b-0ae8c787ff97 req-c3306b0e-912b-451f-b3e1-dc37dd5bc767 tempest-VolumesSnapshotsTestJSON-563659706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:05:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-7867eb9a-ec6d-4c02-8b1b-0ae8c787ff97 req-c3306b0e-912b-451f-b3e1-dc37dd5bc767 tempest-VolumesSnapshotsTestJSON-563659706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:05:56 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [req-7867eb9a-ec6d-4c02-8b1b-0ae8c787ff97 req-c3306b0e-912b-451f-b3e1-dc37dd5bc767 tempest-VolumesSnapshotsTestJSON-563659706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:05:56 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [req-7867eb9a-ec6d-4c02-8b1b-0ae8c787ff97 req-c3306b0e-912b-451f-b3e1-dc37dd5bc767 tempest-VolumesSnapshotsTestJSON-563659706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:05:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-7867eb9a-ec6d-4c02-8b1b-0ae8c787ff97 req-c3306b0e-912b-451f-b3e1-dc37dd5bc767 tempest-VolumesSnapshotsTestJSON-563659706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:05:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-7867eb9a-ec6d-4c02-8b1b-0ae8c787ff97 req-c3306b0e-912b-451f-b3e1-dc37dd5bc767 tempest-VolumesSnapshotsTestJSON-563659706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:05:56 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:05:56 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:05:57 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Jun 30 16:05:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-7867eb9a-ec6d-4c02-8b1b-0ae8c787ff97 req-c3306b0e-912b-451f-b3e1-dc37dd5bc767 tempest-VolumesSnapshotsTestJSON-563659706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.173s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:05:57 devstack cinder-volume[93781]: DEBUG cinder.manager [req-7867eb9a-ec6d-4c02-8b1b-0ae8c787ff97 req-c3306b0e-912b-451f-b3e1-dc37dd5bc767 tempest-VolumesSnapshotsTestJSON-563659706 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:05:57 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-7867eb9a-ec6d-4c02-8b1b-0ae8c787ff97 req-c3306b0e-912b-451f-b3e1-dc37dd5bc767 tempest-VolumesSnapshotsTestJSON-563659706 None] Deleted volume successfully. Jun 30 16:05:57 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-7867eb9a-ec6d-4c02-8b1b-0ae8c787ff97 req-c3306b0e-912b-451f-b3e1-dc37dd5bc767 tempest-VolumesSnapshotsTestJSON-563659706 None] Lock "cinder-dffb2098-87ad-4e4f-97cc-e43a0b46076c-delete_volume" released by "delete_volume" :: held 3.702s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:06:00 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-b7bf28dc-4be7-48e0-8b73-6b873ae61d64 req-b2f043ed-028e-40e2-9495-1eee3f5d3ce0 tempest-DeleteServersTestJSON-1473887185 None] Terminate volume connection completed successfully. Jun 30 16:06:00 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-b7bf28dc-4be7-48e0-8b73-6b873ae61d64 req-b2f043ed-028e-40e2-9495-1eee3f5d3ce0 tempest-DeleteServersTestJSON-1473887185 None] Deleting attachment c2378416-3191-4ad7-bc82-c1bf227feceb. {{(pid=93781) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 30 16:06:05 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-5cba0f86-e9a3-4757-abcb-cbeaeb73aaf2 tempest-GroupSnapshotsTest-1772737832 None] Group tempest-GroupSnapshotsTest-Group-1831928354: creating Jun 30 16:06:05 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-5cba0f86-e9a3-4757-abcb-cbeaeb73aaf2 tempest-GroupSnapshotsTest-1772737832 None] Group tempest-GroupSnapshotsTest-Group-1831928354: created successfully Jun 30 16:06:05 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-5cba0f86-e9a3-4757-abcb-cbeaeb73aaf2 tempest-GroupSnapshotsTest-1772737832 None] Create group completed successfully. Jun 30 16:06:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a6edd096-e767-4ffe-abb6-b8b83e0c9b8a tempest-DeleteServersTestJSON-1473887185 None] Acquiring lock "cinder-aeb58630-f282-452f-a235-8ba950dceb54-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:06:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a6edd096-e767-4ffe-abb6-b8b83e0c9b8a tempest-DeleteServersTestJSON-1473887185 None] Lock "cinder-aeb58630-f282-452f-a235-8ba950dceb54-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:06:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a6edd096-e767-4ffe-abb6-b8b83e0c9b8a tempest-DeleteServersTestJSON-1473887185 None] Acquiring lock "cinder-quobyte-aeb58630-f282-452f-a235-8ba950dceb54" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:06:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a6edd096-e767-4ffe-abb6-b8b83e0c9b8a tempest-DeleteServersTestJSON-1473887185 None] Lock "cinder-quobyte-aeb58630-f282-452f-a235-8ba950dceb54" acquired by "delete_volume" :: waited 0.023s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:06:06 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[4792cbf9-70f9-446d-98c7-d81db22e97f3]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:06:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a6edd096-e767-4ffe-abb6-b8b83e0c9b8a tempest-DeleteServersTestJSON-1473887185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-aeb58630-f282-452f-a235-8ba950dceb54 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:06 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-aeb58630-f282-452f-a235-8ba950dceb54 Jun 30 16:06:06 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:07 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a6edd096-e767-4ffe-abb6-b8b83e0c9b8a tempest-DeleteServersTestJSON-1473887185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-aeb58630-f282-452f-a235-8ba950dceb54" returned: 0 in 1.252s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a6edd096-e767-4ffe-abb6-b8b83e0c9b8a tempest-DeleteServersTestJSON-1473887185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-aeb58630-f282-452f-a235-8ba950dceb54 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:07 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-aeb58630-f282-452f-a235-8ba950dceb54 Jun 30 16:06:07 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Flow 'volume_create_manager' (7f32acb3-bb3f-48c0-a4ae-08abc80eeeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d33b783d-65ad-4546-a2cd-c7f6e798b6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d33b783d-65ad-4546-a2cd-c7f6e798b6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1091899555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ce19704-a6c8-44d2-8119-f3bc34d1e3f9,host='devstack@QuobyteHD#QuobyteHD',id=748a3f37-5ad9-418b-8438-a77af9b4ec5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8519acaaeb214ff6b6aaa0fbccdb0bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:06:08Z,use_quota=True,user_id='365463da209948cea83d9e8f010c0637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b071bb9-e810-4b5e-b3eb-a0a35101ac64),volume_type_id=4b071bb9-e810-4b5e-b3eb-a0a35101ac64)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c92e53-973b-4781-be0e-0e18f9ebfb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c92e53-973b-4781-be0e-0e18f9ebfb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ee612b-3fd1-4640-9d12-8261278e33b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ee612b-3fd1-4640-9d12-8261278e33b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '748a3f37-5ad9-418b-8438-a77af9b4ec5e', 'volume_name': 'volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b71512-41d1-4360-aa5b-98d644477ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b71512-41d1-4360-aa5b-98d644477ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d87e851-e3cc-46a1-91a6-84688e5142b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:08 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Volume 748a3f37-5ad9-418b-8438-a77af9b4ec5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e', 'volume_size': 1} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2ce19704-a6c8-44d2-8119-f3bc34d1e3f9,created_at=2026-06-30T14:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1091899555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ce19704-a6c8-44d2-8119-f3bc34d1e3f9,host='devstack@QuobyteHD#QuobyteHD',id=748a3f37-5ad9-418b-8438-a77af9b4ec5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8519acaaeb214ff6b6aaa0fbccdb0bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:06:08Z,use_quota=True,user_id='365463da209948cea83d9e8f010c0637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b071bb9-e810-4b5e-b3eb-a0a35101ac64),volume_type_id=4b071bb9-e810-4b5e-b3eb-a0a35101ac64)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Creating volume 748a3f37-5ad9-418b-8438-a77af9b4ec5e {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:06:08 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:08 devstack sudo[95349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e 1073741824 Jun 30 16:06:08 devstack sudo[95349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:08 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a6edd096-e767-4ffe-abb6-b8b83e0c9b8a tempest-DeleteServersTestJSON-1473887185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-aeb58630-f282-452f-a235-8ba950dceb54" returned: 0 in 0.825s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a6edd096-e767-4ffe-abb6-b8b83e0c9b8a tempest-DeleteServersTestJSON-1473887185 None] Lock "cinder-quobyte-aeb58630-f282-452f-a235-8ba950dceb54" released by "delete_volume" :: held 2.201s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-a6edd096-e767-4ffe-abb6-b8b83e0c9b8a tempest-DeleteServersTestJSON-1473887185 None] Created reservations ['b9eefcf4-1313-4d16-8413-cc04a7952d1e', '93cf1efb-8fbd-4d5d-a3c6-faf473519940', '3242cb9e-85c9-41f5-ae43-f3a5205c6be7', 'f160fffd-e5b3-480d-a44e-4ffeae442a22'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a6edd096-e767-4ffe-abb6-b8b83e0c9b8a tempest-DeleteServersTestJSON-1473887185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a6edd096-e767-4ffe-abb6-b8b83e0c9b8a tempest-DeleteServersTestJSON-1473887185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a6edd096-e767-4ffe-abb6-b8b83e0c9b8a tempest-DeleteServersTestJSON-1473887185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a6edd096-e767-4ffe-abb6-b8b83e0c9b8a tempest-DeleteServersTestJSON-1473887185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a6edd096-e767-4ffe-abb6-b8b83e0c9b8a tempest-DeleteServersTestJSON-1473887185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:06:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a6edd096-e767-4ffe-abb6-b8b83e0c9b8a tempest-DeleteServersTestJSON-1473887185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:08 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:06:08 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:09 devstack sudo[95349]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e 1073741824" returned: 0 in 1.170s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:09 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e Jun 30 16:06:09 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:10 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a6edd096-e767-4ffe-abb6-b8b83e0c9b8a tempest-DeleteServersTestJSON-1473887185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.209s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:10 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a6edd096-e767-4ffe-abb6-b8b83e0c9b8a tempest-DeleteServersTestJSON-1473887185 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:06:10 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-a6edd096-e767-4ffe-abb6-b8b83e0c9b8a tempest-DeleteServersTestJSON-1473887185 None] Deleted volume successfully. Jun 30 16:06:10 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a6edd096-e767-4ffe-abb6-b8b83e0c9b8a tempest-DeleteServersTestJSON-1473887185 None] Lock "cinder-aeb58630-f282-452f-a235-8ba950dceb54-delete_volume" released by "delete_volume" :: held 3.816s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:06:10 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e" returned: 0 in 0.913s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] <== create_volume: return (2167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:06:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.174s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:06:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d87e851-e3cc-46a1-91a6-84688e5142b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3865aa62-aa25-4c75-8a7f-c458ff434c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:10 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Volume volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e (748a3f37-5ad9-418b-8438-a77af9b4ec5e): created successfully Jun 30 16:06:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3865aa62-aa25-4c75-8a7f-c458ff434c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Flow 'volume_create_manager' (7f32acb3-bb3f-48c0-a4ae-08abc80eeeb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:06:10 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-01a5425b-b114-4e07-8532-92e31b8d92c8 tempest-GroupSnapshotsTest-1772737832 None] Created volume successfully. Jun 30 16:06:12 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-b516c63d-d640-407e-bb3e-4b19438f8c5c tempest-GroupSnapshotsTest-1772737832 None] GroupSnapshot a494a736-24e1-4082-acd5-38999059977b: creating. Jun 30 16:06:12 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b516c63d-d640-407e-bb3e-4b19438f8c5c tempest-GroupSnapshotsTest-1772737832 None] Group snapshot a494a736-24e1-4082-acd5-38999059977b: creating. {{(pid=93781) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 30 16:06:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b516c63d-d640-407e-bb3e-4b19438f8c5c tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:06:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b516c63d-d640-407e-bb3e-4b19438f8c5c tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:06:12 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-b516c63d-d640-407e-bb3e-4b19438f8c5c tempest-GroupSnapshotsTest-1772737832 None] Creating offline snapshot cba934b3-c2ce-428c-a2af-02353f118e8f of volume 748a3f37-5ad9-418b-8438-a77af9b4ec5e {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:06:12 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ef0e3a-7107-454e-8118-1c48ff27f6a4]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:06:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b516c63d-d640-407e-bb3e-4b19438f8c5c tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:12 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e Jun 30 16:06:12 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:13 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b516c63d-d640-407e-bb3e-4b19438f8c5c tempest-GroupSnapshotsTest-1772737832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e" returned: 0 in 0.945s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b516c63d-d640-407e-bb3e-4b19438f8c5c tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.cba934b3-c2ce-428c-a2af-02353f118e8f 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:13 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.cba934b3-c2ce-428c-a2af-02353f118e8f 1G Jun 30 16:06:13 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:14 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b516c63d-d640-407e-bb3e-4b19438f8c5c tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.cba934b3-c2ce-428c-a2af-02353f118e8f 1G" returned: 0 in 0.961s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b516c63d-d640-407e-bb3e-4b19438f8c5c tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.cba934b3-c2ce-428c-a2af-02353f118e8f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:14 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.cba934b3-c2ce-428c-a2af-02353f118e8f Jun 30 16:06:14 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:15 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b516c63d-d640-407e-bb3e-4b19438f8c5c tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.cba934b3-c2ce-428c-a2af-02353f118e8f" returned: 0 in 0.794s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:15 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-b516c63d-d640-407e-bb3e-4b19438f8c5c tempest-GroupSnapshotsTest-1772737832 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.cba934b3-c2ce-428c-a2af-02353f118e8f is being set with open permissions: ugo+rw: NotImplementedError Jun 30 16:06:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b516c63d-d640-407e-bb3e-4b19438f8c5c tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.cba934b3-c2ce-428c-a2af-02353f118e8f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:15 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.cba934b3-c2ce-428c-a2af-02353f118e8f Jun 30 16:06:15 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:16 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b516c63d-d640-407e-bb3e-4b19438f8c5c tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.cba934b3-c2ce-428c-a2af-02353f118e8f" returned: 0 in 0.682s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b516c63d-d640-407e-bb3e-4b19438f8c5c tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:16 devstack sudo[95404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.info Jun 30 16:06:16 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:16 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b516c63d-d640-407e-bb3e-4b19438f8c5c tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.info" returned: 0 in 0.708s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:16 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-b516c63d-d640-407e-bb3e-4b19438f8c5c tempest-GroupSnapshotsTest-1772737832 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.info is being set with open permissions: ugo+rw: NotImplementedError Jun 30 16:06:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b516c63d-d640-407e-bb3e-4b19438f8c5c tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:16 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.info Jun 30 16:06:16 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:17 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b516c63d-d640-407e-bb3e-4b19438f8c5c tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.info" returned: 0 in 0.740s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b516c63d-d640-407e-bb3e-4b19438f8c5c tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.094s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:06:17 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-b516c63d-d640-407e-bb3e-4b19438f8c5c tempest-GroupSnapshotsTest-1772737832 None] group_snapshot a494a736-24e1-4082-acd5-38999059977b: created successfully Jun 30 16:06:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:06:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:06:19 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "cinder-quobyte-cba934b3-c2ce-428c-a2af-02353f118e8f-91d5e49d-9410-4106-b0a6-6658df6fd5cc" by "_create_volume_from_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:06:19 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-cba934b3-c2ce-428c-a2af-02353f118e8f-91d5e49d-9410-4106-b0a6-6658df6fd5cc" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:06:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Creating volume 91d5e49d-9410-4106-b0a6-6658df6fd5cc from snapshot cba934b3-c2ce-428c-a2af-02353f118e8f {{(pid=93781) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 30 16:06:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:06:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:06:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:06:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:06:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:06:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:06:19 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "cinder-quobyte-91d5e49d-9410-4106-b0a6-6658df6fd5cc" by "_copy_volume_from_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:06:19 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-91d5e49d-9410-4106-b0a6-6658df6fd5cc" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:06:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] snapshot: cba934b3-c2ce-428c-a2af-02353f118e8f, volume: 91d5e49d-9410-4106-b0a6-6658df6fd5cc, {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 30 16:06:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:06:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:06:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:06:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:06:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:06:19 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c57dde0-d594-4025-8629-29a8e8cc60d8]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:06:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.cba934b3-c2ce-428c-a2af-02353f118e8f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:20 devstack sudo[95411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.cba934b3-c2ce-428c-a2af-02353f118e8f Jun 30 16:06:20 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:20 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.cba934b3-c2ce-428c-a2af-02353f118e8f" returned: 0 in 1.153s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:20 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:06:20 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] will copy from snapshot at /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 30 16:06:20 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Creating direct copy from snapshot {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 30 16:06:20 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[a914b365-51c0-4e5e-a835-00655c938ab6]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:06:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:21 devstack sudo[95416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e Jun 30 16:06:21 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:22 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e" returned: 0 in 1.093s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:22 devstack cinder-volume[93781]: DEBUG cinder.utils [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Path /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-91d5e49d-9410-4106-b0a6-6658df6fd5cc not found in is_blk_device check {{(pid=93781) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 30 16:06:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-91d5e49d-9410-4106-b0a6-6658df6fd5cc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:22 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-91d5e49d-9410-4106-b0a6-6658df6fd5cc Jun 30 16:06:22 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:28 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-91d5e49d-9410-4106-b0a6-6658df6fd5cc" returned: 0 in 6.249s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:28 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19a616e-4d1f-47d3-9915-31dfbb257790]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:06:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:28 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e Jun 30 16:06:28 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:29 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e" returned: 0 in 1.115s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:29 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Image conversion details: src /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e, size 1024.00 MB, duration 6.25 sec, destination /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-91d5e49d-9410-4106-b0a6-6658df6fd5cc {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:06:29 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Converted 1024.00 MB image at 163.84 MB/s Jun 30 16:06:29 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-91d5e49d-9410-4106-b0a6-6658df6fd5cc is being set with open permissions: ugo+rw: NotImplementedError Jun 30 16:06:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-91d5e49d-9410-4106-b0a6-6658df6fd5cc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:29 devstack sudo[95463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-91d5e49d-9410-4106-b0a6-6658df6fd5cc Jun 30 16:06:29 devstack sudo[95463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:29 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=42,cinder:UPDATE=44,cinder:INSERT=11,cinder:DELETE=3 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:06:29 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:UPDATE=35,cinder:SELECT=45,cinder:INSERT=7,cinder:DELETE=4 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:06:30 devstack sudo[95463]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-91d5e49d-9410-4106-b0a6-6658df6fd5cc" returned: 0 in 0.883s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:30 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-91d5e49d-9410-4106-b0a6-6658df6fd5cc" released by "_copy_volume_from_snapshot" :: held 10.659s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:06:30 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-cba934b3-c2ce-428c-a2af-02353f118e8f-91d5e49d-9410-4106-b0a6-6658df6fd5cc" released by "_create_volume_from_snapshot" :: held 10.712s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:06:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.752s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:06:30 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-3ec270b7-af71-461b-9696-df356a27511e tempest-GroupSnapshotsTest-1772737832 None] Create group from source-snapshot-a494a736-24e1-4082-acd5-38999059977b completed successfully. Jun 30 16:06:31 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1246707a-ef1f-4341-b80a-b15c8078e0f8 tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "cinder-quobyte-91d5e49d-9410-4106-b0a6-6658df6fd5cc" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:06:31 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1246707a-ef1f-4341-b80a-b15c8078e0f8 tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-91d5e49d-9410-4106-b0a6-6658df6fd5cc" acquired by "delete_volume" :: waited 0.021s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:06:31 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3cd70b-befa-4f1a-8686-c3b5c553024b]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:06:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1246707a-ef1f-4341-b80a-b15c8078e0f8 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-91d5e49d-9410-4106-b0a6-6658df6fd5cc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:31 devstack sudo[95470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-91d5e49d-9410-4106-b0a6-6658df6fd5cc Jun 30 16:06:31 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:32 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1246707a-ef1f-4341-b80a-b15c8078e0f8 tempest-GroupSnapshotsTest-1772737832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-91d5e49d-9410-4106-b0a6-6658df6fd5cc" returned: 0 in 1.018s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1246707a-ef1f-4341-b80a-b15c8078e0f8 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-91d5e49d-9410-4106-b0a6-6658df6fd5cc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:32 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-91d5e49d-9410-4106-b0a6-6658df6fd5cc Jun 30 16:06:32 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:32 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:06:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:06:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:06:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:06:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:06:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:06:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:33 devstack sudo[95489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:06:33 devstack sudo[95489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:33 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1246707a-ef1f-4341-b80a-b15c8078e0f8 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-91d5e49d-9410-4106-b0a6-6658df6fd5cc" returned: 0 in 0.806s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1246707a-ef1f-4341-b80a-b15c8078e0f8 tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-91d5e49d-9410-4106-b0a6-6658df6fd5cc" released by "delete_volume" :: held 1.873s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:06:33 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-1246707a-ef1f-4341-b80a-b15c8078e0f8 tempest-GroupSnapshotsTest-1772737832 None] Created reservations ['73375dd9-c62f-4c72-a025-138718d579a1'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:06:33 devstack cinder-volume[93781]: WARNING cinder.quota [None req-1246707a-ef1f-4341-b80a-b15c8078e0f8 tempest-GroupSnapshotsTest-1772737832 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-98222394 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-98222394, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:06:33 devstack cinder-volume[93781]: WARNING cinder.quota [None req-1246707a-ef1f-4341-b80a-b15c8078e0f8 tempest-GroupSnapshotsTest-1772737832 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-98222394 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-98222394, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:06:33 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-1246707a-ef1f-4341-b80a-b15c8078e0f8 tempest-GroupSnapshotsTest-1772737832 None] Created reservations ['11d8ba7d-a176-4683-aabc-cc7440fd5371', '9cc7a4f9-1074-4cab-9a9f-b7c2e4d306b5', '1b09ad4a-3e23-49c5-89b8-ba87deb7bcc4', '71a6481b-13b3-462e-82f0-5112ea58b13a'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:06:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1246707a-ef1f-4341-b80a-b15c8078e0f8 tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:06:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1246707a-ef1f-4341-b80a-b15c8078e0f8 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:06:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1246707a-ef1f-4341-b80a-b15c8078e0f8 tempest-GroupSnapshotsTest-1772737832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:06:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1246707a-ef1f-4341-b80a-b15c8078e0f8 tempest-GroupSnapshotsTest-1772737832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:06:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1246707a-ef1f-4341-b80a-b15c8078e0f8 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:06:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1246707a-ef1f-4341-b80a-b15c8078e0f8 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:33 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:06:33 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:33 devstack sudo[95489]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.860s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:33 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:06:34 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-775768ef-3e53-4f11-a79e-5fad54fc7e4e tempest-GroupSnapshotsTest-1772737832 None] group_snapshot a494a736-24e1-4082-acd5-38999059977b: deleting Jun 30 16:06:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-775768ef-3e53-4f11-a79e-5fad54fc7e4e tempest-GroupSnapshotsTest-1772737832 None] group_snapshot a494a736-24e1-4082-acd5-38999059977b: deleting {{(pid=93781) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 30 16:06:34 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-775768ef-3e53-4f11-a79e-5fad54fc7e4e tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "cinder-quobyte-748a3f37-5ad9-418b-8438-a77af9b4ec5e" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:06:34 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-775768ef-3e53-4f11-a79e-5fad54fc7e4e tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-748a3f37-5ad9-418b-8438-a77af9b4ec5e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:06:34 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-775768ef-3e53-4f11-a79e-5fad54fc7e4e tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "cinder-quobyte-cba934b3-c2ce-428c-a2af-02353f118e8f" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:06:34 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-775768ef-3e53-4f11-a79e-5fad54fc7e4e tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-cba934b3-c2ce-428c-a2af-02353f118e8f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:06:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-775768ef-3e53-4f11-a79e-5fad54fc7e4e tempest-GroupSnapshotsTest-1772737832 None] Deleting offline snapshot cba934b3-c2ce-428c-a2af-02353f118e8f of volume 748a3f37-5ad9-418b-8438-a77af9b4ec5e {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:06:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-775768ef-3e53-4f11-a79e-5fad54fc7e4e tempest-GroupSnapshotsTest-1772737832 None] snapshot_file for this snap is: volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.cba934b3-c2ce-428c-a2af-02353f118e8f {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:06:34 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb27dbfc-c84a-4afa-9a40-6f4197918db3]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:06:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-775768ef-3e53-4f11-a79e-5fad54fc7e4e tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.cba934b3-c2ce-428c-a2af-02353f118e8f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:34 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.cba934b3-c2ce-428c-a2af-02353f118e8f Jun 30 16:06:34 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:34 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1246707a-ef1f-4341-b80a-b15c8078e0f8 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.865s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:34 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-1246707a-ef1f-4341-b80a-b15c8078e0f8 tempest-GroupSnapshotsTest-1772737832 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:06:34 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-1246707a-ef1f-4341-b80a-b15c8078e0f8 tempest-GroupSnapshotsTest-1772737832 None] Delete group completed successfully. Jun 30 16:06:35 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-775768ef-3e53-4f11-a79e-5fad54fc7e4e tempest-GroupSnapshotsTest-1772737832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.cba934b3-c2ce-428c-a2af-02353f118e8f" returned: 0 in 1.103s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:35 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-775768ef-3e53-4f11-a79e-5fad54fc7e4e tempest-GroupSnapshotsTest-1772737832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:06:35 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91c7420-2d82-44a0-8c9b-4ba048e17941]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:06:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-775768ef-3e53-4f11-a79e-5fad54fc7e4e tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:35 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e Jun 30 16:06:35 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:36 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-775768ef-3e53-4f11-a79e-5fad54fc7e4e tempest-GroupSnapshotsTest-1772737832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e" returned: 0 in 0.823s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-775768ef-3e53-4f11-a79e-5fad54fc7e4e tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.cba934b3-c2ce-428c-a2af-02353f118e8f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:36 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.cba934b3-c2ce-428c-a2af-02353f118e8f Jun 30 16:06:36 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:37 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-775768ef-3e53-4f11-a79e-5fad54fc7e4e tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.cba934b3-c2ce-428c-a2af-02353f118e8f" returned: 0 in 1.069s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-775768ef-3e53-4f11-a79e-5fad54fc7e4e tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.cba934b3-c2ce-428c-a2af-02353f118e8f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:37 devstack sudo[95533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.cba934b3-c2ce-428c-a2af-02353f118e8f Jun 30 16:06:37 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:38 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-775768ef-3e53-4f11-a79e-5fad54fc7e4e tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e.cba934b3-c2ce-428c-a2af-02353f118e8f" returned: 0 in 0.711s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-775768ef-3e53-4f11-a79e-5fad54fc7e4e tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-cba934b3-c2ce-428c-a2af-02353f118e8f" released by "_delete_snapshot" :: held 3.825s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:06:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-775768ef-3e53-4f11-a79e-5fad54fc7e4e tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-748a3f37-5ad9-418b-8438-a77af9b4ec5e" released by "delete_snapshot" :: held 3.854s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:06:38 devstack cinder-volume[93781]: WARNING cinder.quota [None req-775768ef-3e53-4f11-a79e-5fad54fc7e4e tempest-GroupSnapshotsTest-1772737832 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-98222394 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-98222394, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:06:38 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-775768ef-3e53-4f11-a79e-5fad54fc7e4e tempest-GroupSnapshotsTest-1772737832 None] Created reservations ['65e6f364-cf4f-408d-86a8-f70d8f38a2fb', 'eccac1cf-c821-4c49-8dac-6c7df67b864f', '82e5a093-8231-49d3-8d98-b43ff64a39a9', '26b1412e-727d-4a81-83b0-c143905f764e'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:06:38 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-775768ef-3e53-4f11-a79e-5fad54fc7e4e tempest-GroupSnapshotsTest-1772737832 None] group_snapshot a494a736-24e1-4082-acd5-38999059977b: deleted successfully Jun 30 16:06:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b5a021df-4cc4-41a8-a708-cbadaae5f8d4 tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "cinder-quobyte-748a3f37-5ad9-418b-8438-a77af9b4ec5e" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:06:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b5a021df-4cc4-41a8-a708-cbadaae5f8d4 tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-748a3f37-5ad9-418b-8438-a77af9b4ec5e" acquired by "delete_volume" :: waited 0.032s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:06:39 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1182ef-e1dc-4dd2-a53c-71e70e221996]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:06:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b5a021df-4cc4-41a8-a708-cbadaae5f8d4 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:39 devstack sudo[95584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e Jun 30 16:06:39 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:40 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b5a021df-4cc4-41a8-a708-cbadaae5f8d4 tempest-GroupSnapshotsTest-1772737832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e" returned: 0 in 0.944s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b5a021df-4cc4-41a8-a708-cbadaae5f8d4 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:40 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e Jun 30 16:06:40 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:40 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b5a021df-4cc4-41a8-a708-cbadaae5f8d4 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-748a3f37-5ad9-418b-8438-a77af9b4ec5e" returned: 0 in 0.718s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:41 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b5a021df-4cc4-41a8-a708-cbadaae5f8d4 tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-748a3f37-5ad9-418b-8438-a77af9b4ec5e" released by "delete_volume" :: held 1.793s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:06:41 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-b5a021df-4cc4-41a8-a708-cbadaae5f8d4 tempest-GroupSnapshotsTest-1772737832 None] Created reservations ['cd3de5b1-d8eb-4d08-a847-08c069559639'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:06:41 devstack cinder-volume[93781]: WARNING cinder.db.api [None req-b5a021df-4cc4-41a8-a708-cbadaae5f8d4 tempest-GroupSnapshotsTest-1772737832 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-98222394'] Jun 30 16:06:41 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-b5a021df-4cc4-41a8-a708-cbadaae5f8d4 tempest-GroupSnapshotsTest-1772737832 None] Created reservations ['e5287a5f-f9c8-440c-b6f2-eb8cbe55229d', '2e6796d0-5088-4a66-aaf9-5db6e04aae66', '93503907-c6a5-4646-b994-74afd7919c11', '85655f1d-4ef3-4810-a88e-b873a45e9633'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:06:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b5a021df-4cc4-41a8-a708-cbadaae5f8d4 tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:06:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b5a021df-4cc4-41a8-a708-cbadaae5f8d4 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:06:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b5a021df-4cc4-41a8-a708-cbadaae5f8d4 tempest-GroupSnapshotsTest-1772737832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:06:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b5a021df-4cc4-41a8-a708-cbadaae5f8d4 tempest-GroupSnapshotsTest-1772737832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:06:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b5a021df-4cc4-41a8-a708-cbadaae5f8d4 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:06:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b5a021df-4cc4-41a8-a708-cbadaae5f8d4 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:41 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:06:41 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:41 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b5a021df-4cc4-41a8-a708-cbadaae5f8d4 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.701s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:41 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-b5a021df-4cc4-41a8-a708-cbadaae5f8d4 tempest-GroupSnapshotsTest-1772737832 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:06:42 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-b5a021df-4cc4-41a8-a708-cbadaae5f8d4 tempest-GroupSnapshotsTest-1772737832 None] Delete group completed successfully. Jun 30 16:06:42 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-b21b1806-ec44-4666-b797-bfa803049ed0 tempest-GroupSnapshotsTest-1772737832 None] Group tempest-GroupSnapshotsTest-Group-1892301963: creating Jun 30 16:06:42 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-b21b1806-ec44-4666-b797-bfa803049ed0 tempest-GroupSnapshotsTest-1772737832 None] Group tempest-GroupSnapshotsTest-Group-1892301963: created successfully Jun 30 16:06:42 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-b21b1806-ec44-4666-b797-bfa803049ed0 tempest-GroupSnapshotsTest-1772737832 None] Create group completed successfully. Jun 30 16:06:44 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:06:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Flow 'volume_create_manager' (d69bac04-530b-4edf-b65c-1bee9c55d432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:06:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4470933b-3a56-4ab6-9341-bf688c30474d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4470933b-3a56-4ab6-9341-bf688c30474d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-215311497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=08d25cec-f412-4c6e-aef6-fc85f028bd26,host='devstack@QuobyteHD#QuobyteHD',id=fb989ae7-b06b-466c-81a7-78ff03ebec7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8519acaaeb214ff6b6aaa0fbccdb0bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:06:44Z,use_quota=True,user_id='365463da209948cea83d9e8f010c0637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(126b4c5e-6096-4ce0-b9cf-ad4bfbef251a),volume_type_id=126b4c5e-6096-4ce0-b9cf-ad4bfbef251a)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587f00ca-037c-40ad-9603-dd5c2e979ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587f00ca-037c-40ad-9603-dd5c2e979ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e73290-81c9-4772-93fe-9efe28b6c867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e73290-81c9-4772-93fe-9efe28b6c867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb989ae7-b06b-466c-81a7-78ff03ebec7c', 'volume_name': 'volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e4c6ec-f62d-4a01-b4c1-9d4c349bcb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e4c6ec-f62d-4a01-b4c1-9d4c349bcb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68001bce-aaad-4b67-8765-a9d137f9817d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:44 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Volume fb989ae7-b06b-466c-81a7-78ff03ebec7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c', 'volume_size': 1} Jun 30 16:06:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:06:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:06:44 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=08d25cec-f412-4c6e-aef6-fc85f028bd26,created_at=2026-06-30T14:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-215311497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=08d25cec-f412-4c6e-aef6-fc85f028bd26,host='devstack@QuobyteHD#QuobyteHD',id=fb989ae7-b06b-466c-81a7-78ff03ebec7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8519acaaeb214ff6b6aaa0fbccdb0bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:06:44Z,use_quota=True,user_id='365463da209948cea83d9e8f010c0637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(126b4c5e-6096-4ce0-b9cf-ad4bfbef251a),volume_type_id=126b4c5e-6096-4ce0-b9cf-ad4bfbef251a)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:06:44 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Creating volume fb989ae7-b06b-466c-81a7-78ff03ebec7c {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:06:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:06:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:06:44 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:06:44 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:06:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:06:44 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:06:44 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:06:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:44 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c 1073741824 Jun 30 16:06:44 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:45 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c 1073741824" returned: 0 in 1.043s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:45 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c Jun 30 16:06:45 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-9b6f4710-b7e4-47f0-bb63-68db375f8ca7 req-7400d128-ce4e-4ecc-a76a-d276203c6e0e tempest-TaggedAttachmentsTest-1608795194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:06:46 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c" returned: 0 in 0.749s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:46 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:06:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:06:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-9b6f4710-b7e4-47f0-bb63-68db375f8ca7 req-7400d128-ce4e-4ecc-a76a-d276203c6e0e tempest-TaggedAttachmentsTest-1608795194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.609s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:06:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68001bce-aaad-4b67-8765-a9d137f9817d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe62ce6-94b8-4bf2-8855-6d0f65ce6f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:46 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Volume volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c (fb989ae7-b06b-466c-81a7-78ff03ebec7c): created successfully Jun 30 16:06:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe62ce6-94b8-4bf2-8855-6d0f65ce6f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Flow 'volume_create_manager' (d69bac04-530b-4edf-b65c-1bee9c55d432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:06:46 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[159ab4a3-027c-4234-bc53-88ea7e5b2f8e]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:06:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-9b6f4710-b7e4-47f0-bb63-68db375f8ca7 req-7400d128-ce4e-4ecc-a76a-d276203c6e0e tempest-TaggedAttachmentsTest-1608795194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-57254cc6-9300-4f55-bc61-c35956bae994 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:46 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-e248b545-a00f-467b-80c6-c7b0f89ffff6 tempest-GroupSnapshotsTest-1772737832 None] Created volume successfully. Jun 30 16:06:46 devstack sudo[95723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-57254cc6-9300-4f55-bc61-c35956bae994 Jun 30 16:06:46 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Flow 'volume_create_manager' (98e59771-f72d-447d-819f-53baeac30b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd4f953-8347-4398-917b-d23e1a01d6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd4f953-8347-4398-917b-d23e1a01d6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-445735182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0d0603-d85b-489c-b740-97212500e024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4144b83f934f7d8e17ab680fb05455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:06:47Z,use_quota=True,user_id='ed6b985f72914c44903d4cb0f64fbac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40361e48-6e72-4055-9f68-db38efa2eb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40361e48-6e72-4055-9f68-db38efa2eb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98b973b-038d-4925-9fd0-14684669bba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98b973b-038d-4925-9fd0-14684669bba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d0d0603-d85b-489c-b740-97212500e024', 'volume_name': 'volume-5d0d0603-d85b-489c-b740-97212500e024', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a312521-b418-4349-b050-217fef9b3ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a312521-b418-4349-b050-217fef9b3ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efaae786-9058-425c-96cc-eaa0f63cfe51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:47 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Volume 5d0d0603-d85b-489c-b740-97212500e024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d0d0603-d85b-489c-b740-97212500e024', 'volume_size': 1} Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:06:47 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-9b6f4710-b7e4-47f0-bb63-68db375f8ca7 req-7400d128-ce4e-4ecc-a76a-d276203c6e0e tempest-TaggedAttachmentsTest-1608795194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-57254cc6-9300-4f55-bc61-c35956bae994" returned: 0 in 1.265s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-9b6f4710-b7e4-47f0-bb63-68db375f8ca7 req-7400d128-ce4e-4ecc-a76a-d276203c6e0e tempest-TaggedAttachmentsTest-1608795194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.336s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.403s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-445735182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0d0603-d85b-489c-b740-97212500e024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4144b83f934f7d8e17ab680fb05455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:06:47Z,use_quota=True,user_id='ed6b985f72914c44903d4cb0f64fbac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Creating volume 5d0d0603-d85b-489c-b740-97212500e024 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:06:47 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5d0d0603-d85b-489c-b740-97212500e024 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:47 devstack sudo[95729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5d0d0603-d85b-489c-b740-97212500e024 1073741824 Jun 30 16:06:47 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-9b6f4710-b7e4-47f0-bb63-68db375f8ca7 req-7400d128-ce4e-4ecc-a76a-d276203c6e0e tempest-TaggedAttachmentsTest-1608795194 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a', 'name': 'volume-57254cc6-9300-4f55-bc61-c35956bae994', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '153866f2-84d5-400d-b19c-d8d105e7186e', 'enforce_multipath': True} {{(pid=93781) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 30 16:06:48 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-9b6f4710-b7e4-47f0-bb63-68db375f8ca7 req-7400d128-ce4e-4ecc-a76a-d276203c6e0e tempest-TaggedAttachmentsTest-1608795194 None] attachment_update completed successfully. Jun 30 16:06:48 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:06:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Flow 'volume_create_manager' (9cd1ed83-f2b1-4280-95e6-fa36d02765a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:06:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38048bb4-f89c-4cbb-9d6a-c2f4326c136c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38048bb4-f89c-4cbb-9d6a-c2f4326c136c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1821521811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=08d25cec-f412-4c6e-aef6-fc85f028bd26,host='devstack@QuobyteHD#QuobyteHD',id=a5d09d11-857d-4477-9388-4dbf81bf8a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8519acaaeb214ff6b6aaa0fbccdb0bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:06:49Z,use_quota=True,user_id='365463da209948cea83d9e8f010c0637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(126b4c5e-6096-4ce0-b9cf-ad4bfbef251a),volume_type_id=126b4c5e-6096-4ce0-b9cf-ad4bfbef251a)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6eb502-24fa-4f22-8188-b3004d248f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6eb502-24fa-4f22-8188-b3004d248f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3930cc3-1933-490f-bb54-8eb888f0b6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3930cc3-1933-490f-bb54-8eb888f0b6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5d09d11-857d-4477-9388-4dbf81bf8a6c', 'volume_name': 'volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db36c51-2f66-4f4a-9570-8143206824ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db36c51-2f66-4f4a-9570-8143206824ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364582e8-4b3a-4f43-ac90-3019077d62a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:48 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Volume a5d09d11-857d-4477-9388-4dbf81bf8a6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c', 'volume_size': 1} Jun 30 16:06:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:06:49 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5d0d0603-d85b-489c-b740-97212500e024 1073741824" returned: 0 in 1.890s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5d0d0603-d85b-489c-b740-97212500e024 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:49 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5d0d0603-d85b-489c-b740-97212500e024 Jun 30 16:06:49 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:50 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5d0d0603-d85b-489c-b740-97212500e024" returned: 0 in 0.737s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:50 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] <== create_volume: return (2714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:06:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.720s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:06:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.591s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:06:50 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=08d25cec-f412-4c6e-aef6-fc85f028bd26,created_at=2026-06-30T14:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1821521811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=08d25cec-f412-4c6e-aef6-fc85f028bd26,host='devstack@QuobyteHD#QuobyteHD',id=a5d09d11-857d-4477-9388-4dbf81bf8a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8519acaaeb214ff6b6aaa0fbccdb0bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:06:49Z,use_quota=True,user_id='365463da209948cea83d9e8f010c0637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(126b4c5e-6096-4ce0-b9cf-ad4bfbef251a),volume_type_id=126b4c5e-6096-4ce0-b9cf-ad4bfbef251a)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:06:50 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Creating volume a5d09d11-857d-4477-9388-4dbf81bf8a6c {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:06:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:06:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:06:50 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:06:50 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:06:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:06:50 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:06:50 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:06:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:50 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efaae786-9058-425c-96cc-eaa0f63cfe51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d0d0603-d85b-489c-b740-97212500e024', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:50 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c82ac15-fabd-492f-9de8-fdaf41e079d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:50 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c 1073741824 Jun 30 16:06:50 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:50 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Volume volume-5d0d0603-d85b-489c-b740-97212500e024 (5d0d0603-d85b-489c-b740-97212500e024): created successfully Jun 30 16:06:50 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c82ac15-fabd-492f-9de8-fdaf41e079d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:50 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Flow 'volume_create_manager' (98e59771-f72d-447d-819f-53baeac30b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:06:50 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-d5085f13-ef3f-4d6d-b115-6cf96fbbe5a4 tempest-VolumesAdminNegativeTest-2146700368 None] Created volume successfully. Jun 30 16:06:51 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-775548fc-e3b0-43a4-ad9d-bf119ac9343b tempest-VolumesAdminNegativeTest-2146700368 None] Acquiring lock "cinder-5d0d0603-d85b-489c-b740-97212500e024-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:06:51 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-775548fc-e3b0-43a4-ad9d-bf119ac9343b tempest-VolumesAdminNegativeTest-2146700368 None] Lock "cinder-5d0d0603-d85b-489c-b740-97212500e024-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:06:51 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-775548fc-e3b0-43a4-ad9d-bf119ac9343b tempest-VolumesAdminNegativeTest-2146700368 None] Acquiring lock "cinder-quobyte-5d0d0603-d85b-489c-b740-97212500e024" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:06:51 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-775548fc-e3b0-43a4-ad9d-bf119ac9343b tempest-VolumesAdminNegativeTest-2146700368 None] Lock "cinder-quobyte-5d0d0603-d85b-489c-b740-97212500e024" acquired by "delete_volume" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:06:51 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c10799-2d39-428d-819a-1809a56f1a06]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:06:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-775548fc-e3b0-43a4-ad9d-bf119ac9343b tempest-VolumesAdminNegativeTest-2146700368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5d0d0603-d85b-489c-b740-97212500e024 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:51 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5d0d0603-d85b-489c-b740-97212500e024 Jun 30 16:06:51 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:51 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c 1073741824" returned: 0 in 1.133s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:51 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c Jun 30 16:06:51 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:52 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-775548fc-e3b0-43a4-ad9d-bf119ac9343b tempest-VolumesAdminNegativeTest-2146700368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5d0d0603-d85b-489c-b740-97212500e024" returned: 0 in 1.146s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-775548fc-e3b0-43a4-ad9d-bf119ac9343b tempest-VolumesAdminNegativeTest-2146700368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5d0d0603-d85b-489c-b740-97212500e024 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:52 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5d0d0603-d85b-489c-b740-97212500e024 Jun 30 16:06:52 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:52 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c" returned: 0 in 1.033s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:52 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] <== create_volume: return (2217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:06:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.220s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:06:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364582e8-4b3a-4f43-ac90-3019077d62a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76501897-9dbf-440c-9cf1-c8054793c611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:06:52 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Volume volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c (a5d09d11-857d-4477-9388-4dbf81bf8a6c): created successfully Jun 30 16:06:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76501897-9dbf-440c-9cf1-c8054793c611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:06:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Flow 'volume_create_manager' (9cd1ed83-f2b1-4280-95e6-fa36d02765a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:06:52 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-ac5df47f-b37a-42f7-a814-8e5cbcf462a4 tempest-GroupSnapshotsTest-1772737832 None] Created volume successfully. Jun 30 16:06:53 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-775548fc-e3b0-43a4-ad9d-bf119ac9343b tempest-VolumesAdminNegativeTest-2146700368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5d0d0603-d85b-489c-b740-97212500e024" returned: 0 in 0.760s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:53 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-775548fc-e3b0-43a4-ad9d-bf119ac9343b tempest-VolumesAdminNegativeTest-2146700368 None] Lock "cinder-quobyte-5d0d0603-d85b-489c-b740-97212500e024" released by "delete_volume" :: held 1.978s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:06:53 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-775548fc-e3b0-43a4-ad9d-bf119ac9343b tempest-VolumesAdminNegativeTest-2146700368 None] Created reservations ['4b17d7cd-d483-42b9-ad1b-7b21ea518a28', 'a3758a28-f3d5-46a2-a37f-b40b5d82d4e3', 'baf2b648-7d1b-4874-b36a-f865a181ffa2', '277864c8-94c8-49e5-b0d9-0c011f3b5deb'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:06:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-775548fc-e3b0-43a4-ad9d-bf119ac9343b tempest-VolumesAdminNegativeTest-2146700368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:06:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-775548fc-e3b0-43a4-ad9d-bf119ac9343b tempest-VolumesAdminNegativeTest-2146700368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:06:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-775548fc-e3b0-43a4-ad9d-bf119ac9343b tempest-VolumesAdminNegativeTest-2146700368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:06:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-775548fc-e3b0-43a4-ad9d-bf119ac9343b tempest-VolumesAdminNegativeTest-2146700368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:06:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-775548fc-e3b0-43a4-ad9d-bf119ac9343b tempest-VolumesAdminNegativeTest-2146700368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:06:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-775548fc-e3b0-43a4-ad9d-bf119ac9343b tempest-VolumesAdminNegativeTest-2146700368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:53 devstack sudo[96171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:06:53 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:06:54 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-2620aa8e-7c6d-4b16-a4d9-41d215f16446 tempest-GroupSnapshotsTest-1772737832 None] Update group completed successfully. Jun 30 16:06:54 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root Jun 30 16:06:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-775548fc-e3b0-43a4-ad9d-bf119ac9343b tempest-VolumesAdminNegativeTest-2146700368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.044s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:06:54 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-775548fc-e3b0-43a4-ad9d-bf119ac9343b tempest-VolumesAdminNegativeTest-2146700368 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:06:54 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-775548fc-e3b0-43a4-ad9d-bf119ac9343b tempest-VolumesAdminNegativeTest-2146700368 None] Deleted volume successfully. Jun 30 16:06:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-775548fc-e3b0-43a4-ad9d-bf119ac9343b tempest-VolumesAdminNegativeTest-2146700368 None] Lock "cinder-5d0d0603-d85b-489c-b740-97212500e024-delete_volume" released by "delete_volume" :: held 3.381s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:06:55 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-57a4c094-4501-41e8-ab7d-a252591e3bb1 tempest-GroupSnapshotsTest-1772737832 None] Update group completed successfully. Jun 30 16:06:56 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-60e8903e-2c39-449f-8c7b-d74f4210fd0e req-25f2be63-c312-4c17-9742-a5d3e95ff43f tempest-TaggedAttachmentsTest-1608795194 None] Terminate volume connection completed successfully. Jun 30 16:06:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-60e8903e-2c39-449f-8c7b-d74f4210fd0e req-25f2be63-c312-4c17-9742-a5d3e95ff43f tempest-TaggedAttachmentsTest-1608795194 None] Deleting attachment 153866f2-84d5-400d-b19c-d8d105e7186e. {{(pid=93781) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 30 16:06:56 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-7c196838-5c5f-43f1-8177-e92b53ce48af tempest-GroupSnapshotsTest-1772737832 None] Update group completed successfully. Jun 30 16:06:57 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-1c3e84e2-4d7e-48eb-8e40-94ab7bd16023 tempest-GroupSnapshotsTest-1772737832 None] Update group completed successfully. Jun 30 16:06:59 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] GroupSnapshot 90e45825-e11f-4f1d-97b2-e4cd7e61ce1d: creating. Jun 30 16:06:59 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] Group snapshot 90e45825-e11f-4f1d-97b2-e4cd7e61ce1d: creating. {{(pid=93781) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 30 16:06:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:06:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:06:59 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] Creating offline snapshot 08fdef0e-6dee-4715-b96f-ae20106acfc2 of volume a5d09d11-857d-4477-9388-4dbf81bf8a6c {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:06:59 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ccce56-a9f8-46e9-a512-512a465bde4c]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:06:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:06:59 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c Jun 30 16:06:59 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:00 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c" returned: 0 in 1.553s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.08fdef0e-6dee-4715-b96f-ae20106acfc2 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:00 devstack sudo[96415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.08fdef0e-6dee-4715-b96f-ae20106acfc2 1G Jun 30 16:07:00 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:01 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.08fdef0e-6dee-4715-b96f-ae20106acfc2 1G" returned: 0 in 1.251s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.08fdef0e-6dee-4715-b96f-ae20106acfc2 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:01 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.08fdef0e-6dee-4715-b96f-ae20106acfc2 Jun 30 16:07:01 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:02 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.08fdef0e-6dee-4715-b96f-ae20106acfc2" returned: 0 in 0.934s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:02 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.08fdef0e-6dee-4715-b96f-ae20106acfc2 is being set with open permissions: ugo+rw: NotImplementedError Jun 30 16:07:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.08fdef0e-6dee-4715-b96f-ae20106acfc2 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:02 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.08fdef0e-6dee-4715-b96f-ae20106acfc2 Jun 30 16:07:02 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:03 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.08fdef0e-6dee-4715-b96f-ae20106acfc2" returned: 0 in 0.990s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:03 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.info Jun 30 16:07:03 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:04 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.info" returned: 0 in 0.811s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:04 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.info is being set with open permissions: ugo+rw: NotImplementedError Jun 30 16:07:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:04 devstack sudo[96439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.info Jun 30 16:07:04 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:05 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.info" returned: 0 in 0.686s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.376s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:07:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:07:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:07:05 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] Creating offline snapshot 85564aab-7c4d-48cd-a85c-bd747b517c31 of volume fb989ae7-b06b-466c-81a7-78ff03ebec7c {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:07:05 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddc8aca-0870-463e-8b57-42b902b8d0fe]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:07:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:05 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c Jun 30 16:07:05 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:07 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c" returned: 0 in 1.504s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.85564aab-7c4d-48cd-a85c-bd747b517c31 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:07 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.85564aab-7c4d-48cd-a85c-bd747b517c31 1G Jun 30 16:07:07 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:08 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.85564aab-7c4d-48cd-a85c-bd747b517c31 1G" returned: 0 in 1.356s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.85564aab-7c4d-48cd-a85c-bd747b517c31 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:08 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.85564aab-7c4d-48cd-a85c-bd747b517c31 Jun 30 16:07:08 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:09 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.85564aab-7c4d-48cd-a85c-bd747b517c31" returned: 0 in 0.785s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:09 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.85564aab-7c4d-48cd-a85c-bd747b517c31 is being set with open permissions: ugo+rw: NotImplementedError Jun 30 16:07:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.85564aab-7c4d-48cd-a85c-bd747b517c31 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:09 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.85564aab-7c4d-48cd-a85c-bd747b517c31 Jun 30 16:07:09 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:10 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.85564aab-7c4d-48cd-a85c-bd747b517c31" returned: 0 in 1.017s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:10 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.info Jun 30 16:07:10 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:11 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.info" returned: 0 in 0.834s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:11 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.info is being set with open permissions: ugo+rw: NotImplementedError Jun 30 16:07:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:11 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.info Jun 30 16:07:11 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:11 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.info" returned: 0 in 0.630s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.264s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:07:11 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-0d3c76c4-92d5-437d-bba6-e5bbbf3f8d5f tempest-GroupSnapshotsTest-1772737832 None] group_snapshot 90e45825-e11f-4f1d-97b2-e4cd7e61ce1d: created successfully Jun 30 16:07:12 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] group_snapshot 90e45825-e11f-4f1d-97b2-e4cd7e61ce1d: deleting Jun 30 16:07:12 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] group_snapshot 90e45825-e11f-4f1d-97b2-e4cd7e61ce1d: deleting {{(pid=93781) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 30 16:07:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "cinder-quobyte-a5d09d11-857d-4477-9388-4dbf81bf8a6c" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:07:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-a5d09d11-857d-4477-9388-4dbf81bf8a6c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:07:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "cinder-quobyte-08fdef0e-6dee-4715-b96f-ae20106acfc2" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:07:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-08fdef0e-6dee-4715-b96f-ae20106acfc2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:07:12 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Deleting offline snapshot 08fdef0e-6dee-4715-b96f-ae20106acfc2 of volume a5d09d11-857d-4477-9388-4dbf81bf8a6c {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:07:12 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] snapshot_file for this snap is: volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.08fdef0e-6dee-4715-b96f-ae20106acfc2 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:07:12 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eea9a99-fda4-40c3-9ff2-65e31069c3a7]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:07:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.08fdef0e-6dee-4715-b96f-ae20106acfc2 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:12 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.08fdef0e-6dee-4715-b96f-ae20106acfc2 Jun 30 16:07:12 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:13 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.08fdef0e-6dee-4715-b96f-ae20106acfc2" returned: 0 in 1.005s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:13 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:07:13 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1af7c5-0148-45d6-b45c-5d639511e8df]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:07:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:13 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c Jun 30 16:07:13 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:14 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c" returned: 0 in 0.755s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.08fdef0e-6dee-4715-b96f-ae20106acfc2 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:14 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.08fdef0e-6dee-4715-b96f-ae20106acfc2 Jun 30 16:07:14 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:15 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.08fdef0e-6dee-4715-b96f-ae20106acfc2" returned: 0 in 0.926s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.08fdef0e-6dee-4715-b96f-ae20106acfc2 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:15 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.08fdef0e-6dee-4715-b96f-ae20106acfc2 Jun 30 16:07:15 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:15 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c.08fdef0e-6dee-4715-b96f-ae20106acfc2" returned: 0 in 0.722s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:15 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-08fdef0e-6dee-4715-b96f-ae20106acfc2" released by "_delete_snapshot" :: held 3.538s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:07:15 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-a5d09d11-857d-4477-9388-4dbf81bf8a6c" released by "delete_snapshot" :: held 3.564s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:07:15 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "cinder-quobyte-fb989ae7-b06b-466c-81a7-78ff03ebec7c" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:07:15 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-fb989ae7-b06b-466c-81a7-78ff03ebec7c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:07:15 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "cinder-quobyte-85564aab-7c4d-48cd-a85c-bd747b517c31" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:07:15 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-85564aab-7c4d-48cd-a85c-bd747b517c31" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:07:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Deleting offline snapshot 85564aab-7c4d-48cd-a85c-bd747b517c31 of volume fb989ae7-b06b-466c-81a7-78ff03ebec7c {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:07:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] snapshot_file for this snap is: volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.85564aab-7c4d-48cd-a85c-bd747b517c31 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:07:15 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ade04c-be34-4de0-abbe-09b49215d585]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:07:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.85564aab-7c4d-48cd-a85c-bd747b517c31 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:16 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.85564aab-7c4d-48cd-a85c-bd747b517c31 Jun 30 16:07:16 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:16 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-21da0ea1-271b-4d58-8311-b1b27b499658 tempest-TaggedAttachmentsTest-1608795194 None] Acquiring lock "cinder-57254cc6-9300-4f55-bc61-c35956bae994-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:07:16 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-21da0ea1-271b-4d58-8311-b1b27b499658 tempest-TaggedAttachmentsTest-1608795194 None] Lock "cinder-57254cc6-9300-4f55-bc61-c35956bae994-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:07:16 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-21da0ea1-271b-4d58-8311-b1b27b499658 tempest-TaggedAttachmentsTest-1608795194 None] Acquiring lock "cinder-quobyte-57254cc6-9300-4f55-bc61-c35956bae994" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:07:16 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-21da0ea1-271b-4d58-8311-b1b27b499658 tempest-TaggedAttachmentsTest-1608795194 None] Lock "cinder-quobyte-57254cc6-9300-4f55-bc61-c35956bae994" acquired by "delete_volume" :: waited 0.015s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:07:16 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2d78db-cb2f-4029-bd5e-338174d103af]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:07:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-21da0ea1-271b-4d58-8311-b1b27b499658 tempest-TaggedAttachmentsTest-1608795194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-57254cc6-9300-4f55-bc61-c35956bae994 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:16 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.85564aab-7c4d-48cd-a85c-bd747b517c31" returned: 0 in 1.032s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:07:17 devstack sudo[96570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-57254cc6-9300-4f55-bc61-c35956bae994 Jun 30 16:07:17 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:17 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0dc80a-f654-4f41-87c4-00bb5cf70191]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:07:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:17 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c Jun 30 16:07:17 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:17 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-21da0ea1-271b-4d58-8311-b1b27b499658 tempest-TaggedAttachmentsTest-1608795194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-57254cc6-9300-4f55-bc61-c35956bae994" returned: 0 in 0.950s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-21da0ea1-271b-4d58-8311-b1b27b499658 tempest-TaggedAttachmentsTest-1608795194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-57254cc6-9300-4f55-bc61-c35956bae994 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:17 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-57254cc6-9300-4f55-bc61-c35956bae994 Jun 30 16:07:17 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:17 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c" returned: 0 in 0.946s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.85564aab-7c4d-48cd-a85c-bd747b517c31 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:18 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.85564aab-7c4d-48cd-a85c-bd747b517c31 Jun 30 16:07:18 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:18 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-21da0ea1-271b-4d58-8311-b1b27b499658 tempest-TaggedAttachmentsTest-1608795194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-57254cc6-9300-4f55-bc61-c35956bae994" returned: 0 in 0.727s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:18 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-21da0ea1-271b-4d58-8311-b1b27b499658 tempest-TaggedAttachmentsTest-1608795194 None] Lock "cinder-quobyte-57254cc6-9300-4f55-bc61-c35956bae994" released by "delete_volume" :: held 1.729s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:07:18 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-21da0ea1-271b-4d58-8311-b1b27b499658 tempest-TaggedAttachmentsTest-1608795194 None] Created reservations ['ffeea743-1c4e-485d-9397-cbd115b41b7b', 'd34a9c21-0f63-4251-bd40-5a144e345cfe', '32977e89-c3c6-4636-bcb0-2509f9557fef', '78bd53a4-849e-4630-a4cb-fdf8046a48f0'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:07:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-21da0ea1-271b-4d58-8311-b1b27b499658 tempest-TaggedAttachmentsTest-1608795194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:07:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-21da0ea1-271b-4d58-8311-b1b27b499658 tempest-TaggedAttachmentsTest-1608795194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:07:18 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-21da0ea1-271b-4d58-8311-b1b27b499658 tempest-TaggedAttachmentsTest-1608795194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:07:18 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-21da0ea1-271b-4d58-8311-b1b27b499658 tempest-TaggedAttachmentsTest-1608795194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:07:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-21da0ea1-271b-4d58-8311-b1b27b499658 tempest-TaggedAttachmentsTest-1608795194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:07:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-21da0ea1-271b-4d58-8311-b1b27b499658 tempest-TaggedAttachmentsTest-1608795194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:18 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:07:18 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:19 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.85564aab-7c4d-48cd-a85c-bd747b517c31" returned: 0 in 1.085s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.85564aab-7c4d-48cd-a85c-bd747b517c31 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:19 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.85564aab-7c4d-48cd-a85c-bd747b517c31 Jun 30 16:07:19 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:19 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-21da0ea1-271b-4d58-8311-b1b27b499658 tempest-TaggedAttachmentsTest-1608795194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.052s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:19 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-21da0ea1-271b-4d58-8311-b1b27b499658 tempest-TaggedAttachmentsTest-1608795194 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:07:19 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-21da0ea1-271b-4d58-8311-b1b27b499658 tempest-TaggedAttachmentsTest-1608795194 None] Deleted volume successfully. Jun 30 16:07:19 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-21da0ea1-271b-4d58-8311-b1b27b499658 tempest-TaggedAttachmentsTest-1608795194 None] Lock "cinder-57254cc6-9300-4f55-bc61-c35956bae994-delete_volume" released by "delete_volume" :: held 3.034s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:07:19 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c.85564aab-7c4d-48cd-a85c-bd747b517c31" returned: 0 in 0.927s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-85564aab-7c4d-48cd-a85c-bd747b517c31" released by "_delete_snapshot" :: held 4.116s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:07:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-fb989ae7-b06b-466c-81a7-78ff03ebec7c" released by "delete_snapshot" :: held 4.147s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:07:20 devstack cinder-volume[93781]: WARNING cinder.quota [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-380334181 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-380334181, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:07:20 devstack cinder-volume[93781]: WARNING cinder.quota [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-380334181 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-380334181, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:07:20 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Created reservations ['6b5c2ae3-30a8-4ac2-a2c2-12f02aa80d5a', '2160e669-ff2f-4c56-b400-832d40246822', '1c8d056f-55bd-442e-b8b6-368a8016618d', '1e099266-3d8c-4ec8-a650-29bb5c5c80c6'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:07:20 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] Created reservations ['58e7f3b6-1ae7-4cfb-9563-bd29149fe3f8', '2d9ffdab-d9db-4bc1-ba1a-84ba304e3729', '9f6a9f6e-1846-4554-9ee0-190a509bb991', '9e1a1aab-679c-4c43-9cc7-39254ae75a84'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:07:20 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-330397c2-025e-4306-bfdb-f6c40dc62631 tempest-GroupSnapshotsTest-1772737832 None] group_snapshot 90e45825-e11f-4f1d-97b2-e4cd7e61ce1d: deleted successfully Jun 30 16:07:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "cinder-quobyte-a5d09d11-857d-4477-9388-4dbf81bf8a6c" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:07:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-a5d09d11-857d-4477-9388-4dbf81bf8a6c" acquired by "delete_volume" :: waited 0.027s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:07:21 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e6a991-4472-4a2f-9b44-d7fe7069be1d]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:07:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:21 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c Jun 30 16:07:21 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:22 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c" returned: 0 in 0.851s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:22 devstack sudo[96602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c Jun 30 16:07:22 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:23 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a5d09d11-857d-4477-9388-4dbf81bf8a6c" returned: 0 in 0.809s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-a5d09d11-857d-4477-9388-4dbf81bf8a6c" released by "delete_volume" :: held 1.734s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:07:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "cinder-quobyte-fb989ae7-b06b-466c-81a7-78ff03ebec7c" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:07:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-fb989ae7-b06b-466c-81a7-78ff03ebec7c" acquired by "delete_volume" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:07:23 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc921f6b-a763-4293-9fde-40a6b4a47ee8]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:07:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:23 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c Jun 30 16:07:23 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:24 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c" returned: 0 in 1.040s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:24 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c Jun 30 16:07:24 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Flow 'volume_create_manager' (67376d11-ffcb-4e6a-a9a0-edd97e773313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6452c622-abe0-4008-ac80-0a23d8959c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6452c622-abe0-4008-ac80-0a23d8959c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1626188566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaf2b191-edae-46d2-8dfd-4199c22926a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1890fc8f3de841f4a74af025a600c6c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:07:25Z,use_quota=True,user_id='3d8d08130132462bbefc8b2316136ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad661aa-90cd-4154-81e8-332ae9940ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad661aa-90cd-4154-81e8-332ae9940ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:07:25 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e359cd94-d2a4-49aa-8380-72a151643761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e359cd94-d2a4-49aa-8380-72a151643761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaf2b191-edae-46d2-8dfd-4199c22926a4', 'volume_name': 'volume-eaf2b191-edae-46d2-8dfd-4199c22926a4', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c211fb9-ff08-4a0d-8290-85f324601e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c211fb9-ff08-4a0d-8290-85f324601e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0525a0d-2574-41c8-b3af-b02469c1f538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:07:25 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Volume eaf2b191-edae-46d2-8dfd-4199c22926a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaf2b191-edae-46d2-8dfd-4199c22926a4', 'volume_size': 1} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1626188566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaf2b191-edae-46d2-8dfd-4199c22926a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1890fc8f3de841f4a74af025a600c6c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:07:25Z,use_quota=True,user_id='3d8d08130132462bbefc8b2316136ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Creating volume eaf2b191-edae-46d2-8dfd-4199c22926a4 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:07:25 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-eaf2b191-edae-46d2-8dfd-4199c22926a4 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb989ae7-b06b-466c-81a7-78ff03ebec7c" returned: 0 in 1.111s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:25 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-eaf2b191-edae-46d2-8dfd-4199c22926a4 1073741824 Jun 30 16:07:25 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-fb989ae7-b06b-466c-81a7-78ff03ebec7c" released by "delete_volume" :: held 2.257s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] Created reservations ['6b04a8e1-5f14-4a2d-ae28-2f4746ff2e13'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:07:25 devstack cinder-volume[93781]: WARNING cinder.quota [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-380334181 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-380334181, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] Created reservations ['eced7db2-ed97-49ec-a16b-d7859260287d', 'c7c1af16-bd0e-43f2-8250-b980427a9549', '4c41dbe1-fc22-4043-8d0b-9efb13555f7a', '0556dd82-a6ff-45d4-9a67-a46d82411750'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] Created reservations ['207efee8-64ac-44c3-92a6-73608610a874', 'a60e6e4b-060c-49a9-a93f-deaade072991', '44416d12-5944-422d-b40f-3402bafe1f89', 'a81fa387-36e2-403f-846b-c8c6fd497011'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:07:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:25 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:07:25 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:26 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-eaf2b191-edae-46d2-8dfd-4199c22926a4 1073741824" returned: 0 in 1.160s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-eaf2b191-edae-46d2-8dfd-4199c22926a4 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:26 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-eaf2b191-edae-46d2-8dfd-4199c22926a4 Jun 30 16:07:26 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:26 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.915s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:26 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:07:26 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-ea77576b-c21c-4147-8ee7-d40507e352e4 tempest-GroupSnapshotsTest-1772737832 None] Delete group completed successfully. Jun 30 16:07:27 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-c7e78123-0818-4e4d-9708-6a553affa1db tempest-GroupSnapshotsTest-1772737832 None] Group tempest-GroupSnapshotsTest-Group-1163118620: creating Jun 30 16:07:27 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-c7e78123-0818-4e4d-9708-6a553affa1db tempest-GroupSnapshotsTest-1772737832 None] Group tempest-GroupSnapshotsTest-Group-1163118620: created successfully Jun 30 16:07:27 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-c7e78123-0818-4e4d-9708-6a553affa1db tempest-GroupSnapshotsTest-1772737832 None] Create group completed successfully. Jun 30 16:07:27 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-eaf2b191-edae-46d2-8dfd-4199c22926a4" returned: 0 in 0.809s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:27 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] <== create_volume: return (2064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:07:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.067s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:07:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0525a0d-2574-41c8-b3af-b02469c1f538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaf2b191-edae-46d2-8dfd-4199c22926a4', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:07:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de8d11e-f994-4293-969a-60deb0314106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:07:27 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Volume volume-eaf2b191-edae-46d2-8dfd-4199c22926a4 (eaf2b191-edae-46d2-8dfd-4199c22926a4): created successfully Jun 30 16:07:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de8d11e-f994-4293-969a-60deb0314106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:07:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Flow 'volume_create_manager' (67376d11-ffcb-4e6a-a9a0-edd97e773313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:07:27 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-5318b794-bdf0-421b-abfb-6af784c41536 tempest-ServerActionsTestOtherA-184782683 None] Created volume successfully. Jun 30 16:07:28 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:07:28 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Flow 'volume_create_manager' (10dbb546-e0b7-49f2-9f88-688f745cb515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:07:28 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7874cf32-5ba3-462e-b7ad-3226719fbba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:07:28 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7874cf32-5ba3-462e-b7ad-3226719fbba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1848872562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=79405e0f-cfeb-49b5-810e-0d5189756009,host='devstack@QuobyteHD#QuobyteHD',id=d0800e8b-74ff-450d-99ee-d9356f82cc43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8519acaaeb214ff6b6aaa0fbccdb0bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:07:29Z,use_quota=True,user_id='365463da209948cea83d9e8f010c0637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76b1384c-9233-4cde-b08c-3d55f0473aca),volume_type_id=76b1384c-9233-4cde-b08c-3d55f0473aca)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:07:28 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19073c72-e46c-4609-8a08-82990064a2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:07:28 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19073c72-e46c-4609-8a08-82990064a2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:07:28 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b92b6ddc-bbb0-4496-9c3e-7f5abc3c55bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:07:28 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b92b6ddc-bbb0-4496-9c3e-7f5abc3c55bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0800e8b-74ff-450d-99ee-d9356f82cc43', 'volume_name': 'volume-d0800e8b-74ff-450d-99ee-d9356f82cc43', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:07:28 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc84ed19-7f0f-477d-b61e-3335f78d0f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:07:28 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc84ed19-7f0f-477d-b61e-3335f78d0f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:07:28 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80860aef-d681-4e29-a225-ade818b3f422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:07:28 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Volume d0800e8b-74ff-450d-99ee-d9356f82cc43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0800e8b-74ff-450d-99ee-d9356f82cc43', 'volume_size': 1} Jun 30 16:07:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:07:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:07:28 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=79405e0f-cfeb-49b5-810e-0d5189756009,created_at=2026-06-30T14:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1848872562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=79405e0f-cfeb-49b5-810e-0d5189756009,host='devstack@QuobyteHD#QuobyteHD',id=d0800e8b-74ff-450d-99ee-d9356f82cc43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8519acaaeb214ff6b6aaa0fbccdb0bdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:07:29Z,use_quota=True,user_id='365463da209948cea83d9e8f010c0637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76b1384c-9233-4cde-b08c-3d55f0473aca),volume_type_id=76b1384c-9233-4cde-b08c-3d55f0473aca)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:07:28 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Creating volume d0800e8b-74ff-450d-99ee-d9356f82cc43 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:07:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:07:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:07:28 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:07:28 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:07:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:07:28 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:07:28 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:07:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:28 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43 1073741824 Jun 30 16:07:28 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:30 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43 1073741824" returned: 0 in 1.159s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:30 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=100,cinder:UPDATE=95,cinder:INSERT=25,cinder:DELETE=3 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:07:30 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:UPDATE=105,cinder:SELECT=92,cinder:INSERT=20,cinder:DELETE=3 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:07:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:30 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43 Jun 30 16:07:30 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:30 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43" returned: 0 in 0.741s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] <== create_volume: return (2070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:07:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.073s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:07:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80860aef-d681-4e29-a225-ade818b3f422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0800e8b-74ff-450d-99ee-d9356f82cc43', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:07:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90dc8132-0c64-4186-84fb-f3a5437aa1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:07:31 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Volume volume-d0800e8b-74ff-450d-99ee-d9356f82cc43 (d0800e8b-74ff-450d-99ee-d9356f82cc43): created successfully Jun 30 16:07:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90dc8132-0c64-4186-84fb-f3a5437aa1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:07:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Flow 'volume_create_manager' (10dbb546-e0b7-49f2-9f88-688f745cb515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:07:31 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-3b8e7231-1135-47e4-93a8-56dbae8b9660 tempest-GroupSnapshotsTest-1772737832 None] Created volume successfully. Jun 30 16:07:31 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-9dcb5539-7045-4831-8773-7a8e8205d659 tempest-GroupSnapshotsTest-1772737832 None] GroupSnapshot a4678d57-70e4-4b8f-84dc-f4ccc1fc52b7: creating. Jun 30 16:07:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9dcb5539-7045-4831-8773-7a8e8205d659 tempest-GroupSnapshotsTest-1772737832 None] Group snapshot a4678d57-70e4-4b8f-84dc-f4ccc1fc52b7: creating. {{(pid=93781) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 30 16:07:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9dcb5539-7045-4831-8773-7a8e8205d659 tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:07:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9dcb5539-7045-4831-8773-7a8e8205d659 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:07:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-9dcb5539-7045-4831-8773-7a8e8205d659 tempest-GroupSnapshotsTest-1772737832 None] Creating offline snapshot ecd0c247-793f-4977-8f84-eb044d1d2a5c of volume d0800e8b-74ff-450d-99ee-d9356f82cc43 {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:07:31 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[a603b7fe-c057-47dc-a41e-6abd905b8ee6]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:07:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9dcb5539-7045-4831-8773-7a8e8205d659 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:31 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43 Jun 30 16:07:31 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:32 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9dcb5539-7045-4831-8773-7a8e8205d659 tempest-GroupSnapshotsTest-1772737832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43" returned: 0 in 1.163s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9dcb5539-7045-4831-8773-7a8e8205d659 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.ecd0c247-793f-4977-8f84-eb044d1d2a5c 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:32 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.ecd0c247-793f-4977-8f84-eb044d1d2a5c 1G Jun 30 16:07:32 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:32 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:07:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 8 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:07:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:07:33 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9dcb5539-7045-4831-8773-7a8e8205d659 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.ecd0c247-793f-4977-8f84-eb044d1d2a5c 1G" returned: 0 in 0.967s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9dcb5539-7045-4831-8773-7a8e8205d659 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0800e8b-74ff-450d-99ee-d9356f82cc43 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.ecd0c247-793f-4977-8f84-eb044d1d2a5c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:33 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0800e8b-74ff-450d-99ee-d9356f82cc43 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.ecd0c247-793f-4977-8f84-eb044d1d2a5c Jun 30 16:07:33 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:34 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9dcb5539-7045-4831-8773-7a8e8205d659 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0800e8b-74ff-450d-99ee-d9356f82cc43 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.ecd0c247-793f-4977-8f84-eb044d1d2a5c" returned: 0 in 0.885s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:34 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-9dcb5539-7045-4831-8773-7a8e8205d659 tempest-GroupSnapshotsTest-1772737832 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.ecd0c247-793f-4977-8f84-eb044d1d2a5c is being set with open permissions: ugo+rw: NotImplementedError Jun 30 16:07:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9dcb5539-7045-4831-8773-7a8e8205d659 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.ecd0c247-793f-4977-8f84-eb044d1d2a5c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:34 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.ecd0c247-793f-4977-8f84-eb044d1d2a5c Jun 30 16:07:34 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:35 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9dcb5539-7045-4831-8773-7a8e8205d659 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.ecd0c247-793f-4977-8f84-eb044d1d2a5c" returned: 0 in 0.815s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9dcb5539-7045-4831-8773-7a8e8205d659 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:35 devstack sudo[96669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.info Jun 30 16:07:35 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:36 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9dcb5539-7045-4831-8773-7a8e8205d659 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.info" returned: 0 in 0.791s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:36 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-9dcb5539-7045-4831-8773-7a8e8205d659 tempest-GroupSnapshotsTest-1772737832 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.info is being set with open permissions: ugo+rw: NotImplementedError Jun 30 16:07:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9dcb5539-7045-4831-8773-7a8e8205d659 tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:36 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.info Jun 30 16:07:36 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:37 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9dcb5539-7045-4831-8773-7a8e8205d659 tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.info" returned: 0 in 0.954s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9dcb5539-7045-4831-8773-7a8e8205d659 tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.689s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:07:37 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-9dcb5539-7045-4831-8773-7a8e8205d659 tempest-GroupSnapshotsTest-1772737832 None] group_snapshot a4678d57-70e4-4b8f-84dc-f4ccc1fc52b7: created successfully Jun 30 16:07:38 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-6446fba1-5562-459c-b7e6-204bcd54994d tempest-GroupSnapshotsTest-1772737832 None] group_snapshot a4678d57-70e4-4b8f-84dc-f4ccc1fc52b7: deleting Jun 30 16:07:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6446fba1-5562-459c-b7e6-204bcd54994d tempest-GroupSnapshotsTest-1772737832 None] group_snapshot a4678d57-70e4-4b8f-84dc-f4ccc1fc52b7: deleting {{(pid=93781) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 30 16:07:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6446fba1-5562-459c-b7e6-204bcd54994d tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "cinder-quobyte-d0800e8b-74ff-450d-99ee-d9356f82cc43" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:07:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6446fba1-5562-459c-b7e6-204bcd54994d tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-d0800e8b-74ff-450d-99ee-d9356f82cc43" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:07:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6446fba1-5562-459c-b7e6-204bcd54994d tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "cinder-quobyte-ecd0c247-793f-4977-8f84-eb044d1d2a5c" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:07:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6446fba1-5562-459c-b7e6-204bcd54994d tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-ecd0c247-793f-4977-8f84-eb044d1d2a5c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:07:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-6446fba1-5562-459c-b7e6-204bcd54994d tempest-GroupSnapshotsTest-1772737832 None] Deleting offline snapshot ecd0c247-793f-4977-8f84-eb044d1d2a5c of volume d0800e8b-74ff-450d-99ee-d9356f82cc43 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:07:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-6446fba1-5562-459c-b7e6-204bcd54994d tempest-GroupSnapshotsTest-1772737832 None] snapshot_file for this snap is: volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.ecd0c247-793f-4977-8f84-eb044d1d2a5c {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:07:38 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[a474649a-b11d-44c0-b80b-5cf1055f77d4]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:07:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6446fba1-5562-459c-b7e6-204bcd54994d tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.ecd0c247-793f-4977-8f84-eb044d1d2a5c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:38 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.ecd0c247-793f-4977-8f84-eb044d1d2a5c Jun 30 16:07:38 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:39 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6446fba1-5562-459c-b7e6-204bcd54994d tempest-GroupSnapshotsTest-1772737832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.ecd0c247-793f-4977-8f84-eb044d1d2a5c" returned: 0 in 1.100s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-6446fba1-5562-459c-b7e6-204bcd54994d tempest-GroupSnapshotsTest-1772737832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0800e8b-74ff-450d-99ee-d9356f82cc43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:07:39 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbe99bd-ab83-45c3-ab2a-287cf31a2283]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:07:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6446fba1-5562-459c-b7e6-204bcd54994d tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:39 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43 Jun 30 16:07:39 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:40 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6446fba1-5562-459c-b7e6-204bcd54994d tempest-GroupSnapshotsTest-1772737832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43" returned: 0 in 0.875s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6446fba1-5562-459c-b7e6-204bcd54994d tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.ecd0c247-793f-4977-8f84-eb044d1d2a5c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:40 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.ecd0c247-793f-4977-8f84-eb044d1d2a5c Jun 30 16:07:40 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:41 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6446fba1-5562-459c-b7e6-204bcd54994d tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.ecd0c247-793f-4977-8f84-eb044d1d2a5c" returned: 0 in 0.964s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6446fba1-5562-459c-b7e6-204bcd54994d tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.ecd0c247-793f-4977-8f84-eb044d1d2a5c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:41 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.ecd0c247-793f-4977-8f84-eb044d1d2a5c Jun 30 16:07:41 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:42 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6446fba1-5562-459c-b7e6-204bcd54994d tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43.ecd0c247-793f-4977-8f84-eb044d1d2a5c" returned: 0 in 0.729s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:42 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6446fba1-5562-459c-b7e6-204bcd54994d tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-ecd0c247-793f-4977-8f84-eb044d1d2a5c" released by "_delete_snapshot" :: held 3.852s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:07:42 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6446fba1-5562-459c-b7e6-204bcd54994d tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-d0800e8b-74ff-450d-99ee-d9356f82cc43" released by "delete_snapshot" :: held 3.888s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:07:42 devstack cinder-volume[93781]: WARNING cinder.quota [None req-6446fba1-5562-459c-b7e6-204bcd54994d tempest-GroupSnapshotsTest-1772737832 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1956234746 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1956234746, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:07:42 devstack cinder-volume[93781]: WARNING cinder.quota [None req-6446fba1-5562-459c-b7e6-204bcd54994d tempest-GroupSnapshotsTest-1772737832 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1956234746 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1956234746, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:07:42 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-6446fba1-5562-459c-b7e6-204bcd54994d tempest-GroupSnapshotsTest-1772737832 None] Created reservations ['06c02cf9-5a49-40c3-833e-2da8a2f688c3', '729ee574-bd2c-4106-b4a0-96c416cdf724', '6112d668-9a30-48a0-9cc1-ed1ef38d7cc6', '00b0ba20-59ac-431f-a18f-e5af7ab16608'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:07:42 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-6446fba1-5562-459c-b7e6-204bcd54994d tempest-GroupSnapshotsTest-1772737832 None] group_snapshot a4678d57-70e4-4b8f-84dc-f4ccc1fc52b7: deleted successfully Jun 30 16:07:43 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-151835eb-07d7-4725-8123-d3504d29a66c tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "cinder-quobyte-d0800e8b-74ff-450d-99ee-d9356f82cc43" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:07:43 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-151835eb-07d7-4725-8123-d3504d29a66c tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-d0800e8b-74ff-450d-99ee-d9356f82cc43" acquired by "delete_volume" :: waited 0.033s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:07:43 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9a482e-b661-46e7-b1bd-3decda704cb2]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:07:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-151835eb-07d7-4725-8123-d3504d29a66c tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:43 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43 Jun 30 16:07:43 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:44 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-151835eb-07d7-4725-8123-d3504d29a66c tempest-GroupSnapshotsTest-1772737832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43" returned: 0 in 1.084s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-151835eb-07d7-4725-8123-d3504d29a66c tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:44 devstack sudo[96742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43 Jun 30 16:07:44 devstack sudo[96742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:45 devstack sudo[96742]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-151835eb-07d7-4725-8123-d3504d29a66c tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d0800e8b-74ff-450d-99ee-d9356f82cc43" returned: 0 in 1.306s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-151835eb-07d7-4725-8123-d3504d29a66c tempest-GroupSnapshotsTest-1772737832 None] Lock "cinder-quobyte-d0800e8b-74ff-450d-99ee-d9356f82cc43" released by "delete_volume" :: held 2.505s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:07:45 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-151835eb-07d7-4725-8123-d3504d29a66c tempest-GroupSnapshotsTest-1772737832 None] Created reservations ['8b5b621a-02e2-4910-86cc-67d668a530b8'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:07:45 devstack cinder-volume[93781]: WARNING cinder.quota [None req-151835eb-07d7-4725-8123-d3504d29a66c tempest-GroupSnapshotsTest-1772737832 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1956234746 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1956234746, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:07:45 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-151835eb-07d7-4725-8123-d3504d29a66c tempest-GroupSnapshotsTest-1772737832 None] Created reservations ['6c6a3f84-fbc2-4f2d-98c4-69ed8dd1a08d', '22c672b7-bd76-4cdb-a61d-b1e1deb28455', 'e03c13e9-d91a-4da4-9d8b-ca8c070379a4', '27636146-6c94-422f-ae7d-03f55e039e53'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:07:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-151835eb-07d7-4725-8123-d3504d29a66c tempest-GroupSnapshotsTest-1772737832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:07:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-151835eb-07d7-4725-8123-d3504d29a66c tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:07:45 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-151835eb-07d7-4725-8123-d3504d29a66c tempest-GroupSnapshotsTest-1772737832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:07:45 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-151835eb-07d7-4725-8123-d3504d29a66c tempest-GroupSnapshotsTest-1772737832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:07:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-151835eb-07d7-4725-8123-d3504d29a66c tempest-GroupSnapshotsTest-1772737832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:07:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-151835eb-07d7-4725-8123-d3504d29a66c tempest-GroupSnapshotsTest-1772737832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:45 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:07:45 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:46 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-151835eb-07d7-4725-8123-d3504d29a66c tempest-GroupSnapshotsTest-1772737832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.930s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:46 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-151835eb-07d7-4725-8123-d3504d29a66c tempest-GroupSnapshotsTest-1772737832 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:07:46 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-151835eb-07d7-4725-8123-d3504d29a66c tempest-GroupSnapshotsTest-1772737832 None] Delete group completed successfully. Jun 30 16:07:55 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-52edee89-dfc4-409b-a2b9-a7f9916bf999 tempest-GroupsTest-1773125808 None] Group tempest-Group1-1678779843: creating Jun 30 16:07:55 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-52edee89-dfc4-409b-a2b9-a7f9916bf999 tempest-GroupsTest-1773125808 None] Group tempest-Group1-1678779843: created successfully Jun 30 16:07:55 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-52edee89-dfc4-409b-a2b9-a7f9916bf999 tempest-GroupsTest-1773125808 None] Create group completed successfully. Jun 30 16:07:56 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-d2569cdd-e4c5-49ad-9e18-a737807171dc tempest-GroupsTest-1773125808 None] Group tempest-Group2-2126069770: creating Jun 30 16:07:56 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-d2569cdd-e4c5-49ad-9e18-a737807171dc tempest-GroupsTest-1773125808 None] Group tempest-Group2-2126069770: created successfully Jun 30 16:07:56 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-d2569cdd-e4c5-49ad-9e18-a737807171dc tempest-GroupsTest-1773125808 None] Create group completed successfully. Jun 30 16:07:58 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:07:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Flow 'volume_create_manager' (5730c991-b4e2-4c1d-aea7-2326de7dc6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:07:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660fd7a7-1148-4888-9abe-aa6ab238d2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:07:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660fd7a7-1148-4888-9abe-aa6ab238d2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-215077475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29dbc870-6d55-486c-b982-85787d4f48a5,host='devstack@QuobyteHD#QuobyteHD',id=fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd5404891b74f42ab696af850d339cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:07:58Z,use_quota=True,user_id='8033e1ba2ee54cc4948d62e150af69a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a53d81e-a144-474f-8ff3-ec5c023c672d),volume_type_id=9a53d81e-a144-474f-8ff3-ec5c023c672d)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:07:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86b1ac7-1cbf-4491-9be6-3a2d701bd3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:07:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86b1ac7-1cbf-4491-9be6-3a2d701bd3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:07:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (509aba23-6422-4eb1-82b4-60b550b9f835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:07:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (509aba23-6422-4eb1-82b4-60b550b9f835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac', 'volume_name': 'volume-fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:07:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d1857d-8282-47b2-aace-33de92cdd709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:07:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d1857d-8282-47b2-aace-33de92cdd709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:07:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb5fdf3-94ad-43ea-b579-e994beeecb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:07:58 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Volume fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac', 'volume_size': 1} Jun 30 16:07:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:07:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:07:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=29dbc870-6d55-486c-b982-85787d4f48a5,created_at=2026-06-30T14:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-215077475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29dbc870-6d55-486c-b982-85787d4f48a5,host='devstack@QuobyteHD#QuobyteHD',id=fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd5404891b74f42ab696af850d339cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:07:58Z,use_quota=True,user_id='8033e1ba2ee54cc4948d62e150af69a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a53d81e-a144-474f-8ff3-ec5c023c672d),volume_type_id=9a53d81e-a144-474f-8ff3-ec5c023c672d)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:07:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Creating volume fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:07:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:07:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:07:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:07:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:07:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:07:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:07:58 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:07:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:58 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac 1073741824 Jun 30 16:07:58 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:07:59 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Jun 30 16:07:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac 1073741824" returned: 0 in 0.919s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:07:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:07:59 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac Jun 30 16:07:59 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:00 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac" returned: 0 in 0.759s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:00 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:08:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:08:00 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb5fdf3-94ad-43ea-b579-e994beeecb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:00 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a33d2177-6db3-4cf4-9683-ce67f7486bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:00 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Volume volume-fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac (fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac): created successfully Jun 30 16:08:00 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a33d2177-6db3-4cf4-9683-ce67f7486bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:00 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Flow 'volume_create_manager' (5730c991-b4e2-4c1d-aea7-2326de7dc6d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:08:00 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-bf90223c-585d-4f67-9065-1f958f959400 tempest-GroupsTest-1773125808 None] Created volume successfully. Jun 30 16:08:02 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-0f4da3fc-fcb3-420f-9a29-30f38696cbd8 tempest-GroupsTest-1773125808 None] Acquiring lock "cinder-quobyte-fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:08:02 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-0f4da3fc-fcb3-420f-9a29-30f38696cbd8 tempest-GroupsTest-1773125808 None] Lock "cinder-quobyte-fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac" acquired by "delete_volume" :: waited 0.061s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:08:02 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d56c9d4-106d-47d1-a9df-0f7833d33026]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:08:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0f4da3fc-fcb3-420f-9a29-30f38696cbd8 tempest-GroupsTest-1773125808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:02 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac Jun 30 16:08:02 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:04 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0f4da3fc-fcb3-420f-9a29-30f38696cbd8 tempest-GroupsTest-1773125808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac" returned: 0 in 1.729s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0f4da3fc-fcb3-420f-9a29-30f38696cbd8 tempest-GroupsTest-1773125808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:04 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac Jun 30 16:08:04 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:05 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0f4da3fc-fcb3-420f-9a29-30f38696cbd8 tempest-GroupsTest-1773125808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac" returned: 0 in 0.984s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:05 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-0f4da3fc-fcb3-420f-9a29-30f38696cbd8 tempest-GroupsTest-1773125808 None] Lock "cinder-quobyte-fb65a8a5-b396-4a2e-9bcb-81bd4c5feaac" released by "delete_volume" :: held 2.848s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:08:05 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-0f4da3fc-fcb3-420f-9a29-30f38696cbd8 tempest-GroupsTest-1773125808 None] Created reservations ['3f76a20d-acbc-47a2-83bc-b4f43fe31186'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:08:05 devstack cinder-volume[93781]: WARNING cinder.quota [None req-0f4da3fc-fcb3-420f-9a29-30f38696cbd8 tempest-GroupsTest-1773125808 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-114229982 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-114229982, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:08:05 devstack cinder-volume[93781]: WARNING cinder.quota [None req-0f4da3fc-fcb3-420f-9a29-30f38696cbd8 tempest-GroupsTest-1773125808 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-114229982 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-114229982, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:08:05 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-0f4da3fc-fcb3-420f-9a29-30f38696cbd8 tempest-GroupsTest-1773125808 None] Created reservations ['e1759b00-7af1-4bc4-a143-cbf2271813da', '998761ad-6192-45bc-b6db-ee504cb54f72', 'd0591a25-bb1e-4c2b-ac95-743931fa0945', 'a63ae5be-a524-41d2-b9fb-5907f05b85fb'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:08:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0f4da3fc-fcb3-420f-9a29-30f38696cbd8 tempest-GroupsTest-1773125808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:08:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0f4da3fc-fcb3-420f-9a29-30f38696cbd8 tempest-GroupsTest-1773125808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:08:05 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-0f4da3fc-fcb3-420f-9a29-30f38696cbd8 tempest-GroupsTest-1773125808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:08:05 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-0f4da3fc-fcb3-420f-9a29-30f38696cbd8 tempest-GroupsTest-1773125808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:08:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0f4da3fc-fcb3-420f-9a29-30f38696cbd8 tempest-GroupsTest-1773125808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:08:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0f4da3fc-fcb3-420f-9a29-30f38696cbd8 tempest-GroupsTest-1773125808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:05 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:08:05 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:06 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0f4da3fc-fcb3-420f-9a29-30f38696cbd8 tempest-GroupsTest-1773125808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.026s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:06 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-0f4da3fc-fcb3-420f-9a29-30f38696cbd8 tempest-GroupsTest-1773125808 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:08:06 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-0f4da3fc-fcb3-420f-9a29-30f38696cbd8 tempest-GroupsTest-1773125808 None] Delete group completed successfully. Jun 30 16:08:06 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-8fbf68db-7143-476e-9203-6ae63e5b9a05 tempest-GroupsTest-1773125808 None] Created reservations ['ec8bd36a-1be1-49e7-95b0-b686f6458a5c'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:08:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8fbf68db-7143-476e-9203-6ae63e5b9a05 tempest-GroupsTest-1773125808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:08:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8fbf68db-7143-476e-9203-6ae63e5b9a05 tempest-GroupsTest-1773125808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:08:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-8fbf68db-7143-476e-9203-6ae63e5b9a05 tempest-GroupsTest-1773125808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:08:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-8fbf68db-7143-476e-9203-6ae63e5b9a05 tempest-GroupsTest-1773125808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:08:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8fbf68db-7143-476e-9203-6ae63e5b9a05 tempest-GroupsTest-1773125808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:08:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8fbf68db-7143-476e-9203-6ae63e5b9a05 tempest-GroupsTest-1773125808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:06 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:08:06 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:07 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8fbf68db-7143-476e-9203-6ae63e5b9a05 tempest-GroupsTest-1773125808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.164s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:07 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-8fbf68db-7143-476e-9203-6ae63e5b9a05 tempest-GroupsTest-1773125808 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:08:07 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-8fbf68db-7143-476e-9203-6ae63e5b9a05 tempest-GroupsTest-1773125808 None] Delete group completed successfully. Jun 30 16:08:08 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-fe48c2b1-091c-49b7-b72c-c9ff8a00632b tempest-GroupsTest-1773125808 None] Group tempest-GroupsTest-Group-1260329507: creating Jun 30 16:08:08 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-fe48c2b1-091c-49b7-b72c-c9ff8a00632b tempest-GroupsTest-1773125808 None] Group tempest-GroupsTest-Group-1260329507: created successfully Jun 30 16:08:08 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-fe48c2b1-091c-49b7-b72c-c9ff8a00632b tempest-GroupsTest-1773125808 None] Create group completed successfully. Jun 30 16:08:10 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:08:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Flow 'volume_create_manager' (3fbe69eb-1387-4ddb-9ded-ececf2379e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:08:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304f7c40-f6c3-47d4-a189-72fc3f80f7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304f7c40-f6c3-47d4-a189-72fc3f80f7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-488476378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4485f521-7929-4091-b07c-779f933b46d6,host='devstack@QuobyteHD#QuobyteHD',id=b865cd73-8850-4cd1-99b0-c10c20c0ce35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd5404891b74f42ab696af850d339cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:08:10Z,use_quota=True,user_id='8033e1ba2ee54cc4948d62e150af69a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(222e43d0-e288-44f1-a6c6-91d803259896),volume_type_id=222e43d0-e288-44f1-a6c6-91d803259896)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202950a0-5ccd-4612-8ad4-e069f4d278b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202950a0-5ccd-4612-8ad4-e069f4d278b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362600b2-de83-4671-b2a9-d500ae0ff2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362600b2-de83-4671-b2a9-d500ae0ff2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b865cd73-8850-4cd1-99b0-c10c20c0ce35', 'volume_name': 'volume-b865cd73-8850-4cd1-99b0-c10c20c0ce35', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f4c445d-8549-4747-ac04-f62858a969cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f4c445d-8549-4747-ac04-f62858a969cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8da155a-402f-4baa-a422-4bfa8e0b29d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:10 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Volume b865cd73-8850-4cd1-99b0-c10c20c0ce35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b865cd73-8850-4cd1-99b0-c10c20c0ce35', 'volume_size': 1} Jun 30 16:08:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:08:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:08:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4485f521-7929-4091-b07c-779f933b46d6,created_at=2026-06-30T14:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-488476378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4485f521-7929-4091-b07c-779f933b46d6,host='devstack@QuobyteHD#QuobyteHD',id=b865cd73-8850-4cd1-99b0-c10c20c0ce35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd5404891b74f42ab696af850d339cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:08:10Z,use_quota=True,user_id='8033e1ba2ee54cc4948d62e150af69a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(222e43d0-e288-44f1-a6c6-91d803259896),volume_type_id=222e43d0-e288-44f1-a6c6-91d803259896)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:08:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Creating volume b865cd73-8850-4cd1-99b0-c10c20c0ce35 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:08:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:08:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:08:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:08:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:08:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:08:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:08:10 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:08:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b865cd73-8850-4cd1-99b0-c10c20c0ce35 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:10 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b865cd73-8850-4cd1-99b0-c10c20c0ce35 1073741824 Jun 30 16:08:10 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:11 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b865cd73-8850-4cd1-99b0-c10c20c0ce35 1073741824" returned: 0 in 1.011s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b865cd73-8850-4cd1-99b0-c10c20c0ce35 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:11 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b865cd73-8850-4cd1-99b0-c10c20c0ce35 Jun 30 16:08:11 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:12 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b865cd73-8850-4cd1-99b0-c10c20c0ce35" returned: 0 in 0.861s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:12 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] <== create_volume: return (1950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:08:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:08:12 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8da155a-402f-4baa-a422-4bfa8e0b29d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b865cd73-8850-4cd1-99b0-c10c20c0ce35', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:12 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f55e3b-8f6f-4c5f-ace1-ce5fe636ce8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:12 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Volume volume-b865cd73-8850-4cd1-99b0-c10c20c0ce35 (b865cd73-8850-4cd1-99b0-c10c20c0ce35): created successfully Jun 30 16:08:12 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f55e3b-8f6f-4c5f-ace1-ce5fe636ce8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:12 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Flow 'volume_create_manager' (3fbe69eb-1387-4ddb-9ded-ececf2379e87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:08:12 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-4a7f12d8-6227-4f8e-9126-7cabe56c338c tempest-GroupsTest-1773125808 None] Created volume successfully. Jun 30 16:08:14 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:08:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Flow 'volume_create_manager' (76357a1b-2253-420b-a7ee-53807d6aae8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:08:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d1d8e9-9d38-48ae-bfa5-57e98ed71cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d1d8e9-9d38-48ae-bfa5-57e98ed71cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-358357263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4485f521-7929-4091-b07c-779f933b46d6,host='devstack@QuobyteHD#QuobyteHD',id=82c2d65b-b56a-4ef7-a3f3-c500bae40125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd5404891b74f42ab696af850d339cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:08:15Z,use_quota=True,user_id='8033e1ba2ee54cc4948d62e150af69a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(222e43d0-e288-44f1-a6c6-91d803259896),volume_type_id=222e43d0-e288-44f1-a6c6-91d803259896)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (616ae261-0a60-4d54-aba9-033c43082ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (616ae261-0a60-4d54-aba9-033c43082ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f3d4de-a76a-4435-805e-d6e4a70a046f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f3d4de-a76a-4435-805e-d6e4a70a046f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82c2d65b-b56a-4ef7-a3f3-c500bae40125', 'volume_name': 'volume-82c2d65b-b56a-4ef7-a3f3-c500bae40125', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c517e473-1546-40fc-a3b3-198131bcd227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c517e473-1546-40fc-a3b3-198131bcd227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854db4de-585b-451c-a9ad-56565653a442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:14 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Volume 82c2d65b-b56a-4ef7-a3f3-c500bae40125: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82c2d65b-b56a-4ef7-a3f3-c500bae40125', 'volume_size': 1} Jun 30 16:08:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:08:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:08:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4485f521-7929-4091-b07c-779f933b46d6,created_at=2026-06-30T14:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-358357263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4485f521-7929-4091-b07c-779f933b46d6,host='devstack@QuobyteHD#QuobyteHD',id=82c2d65b-b56a-4ef7-a3f3-c500bae40125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd5404891b74f42ab696af850d339cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:08:15Z,use_quota=True,user_id='8033e1ba2ee54cc4948d62e150af69a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(222e43d0-e288-44f1-a6c6-91d803259896),volume_type_id=222e43d0-e288-44f1-a6c6-91d803259896)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:08:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Creating volume 82c2d65b-b56a-4ef7-a3f3-c500bae40125 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:08:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:08:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:08:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:08:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:08:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:08:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:08:14 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:08:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-82c2d65b-b56a-4ef7-a3f3-c500bae40125 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:14 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-82c2d65b-b56a-4ef7-a3f3-c500bae40125 1073741824 Jun 30 16:08:14 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:16 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-82c2d65b-b56a-4ef7-a3f3-c500bae40125 1073741824" returned: 0 in 1.559s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-82c2d65b-b56a-4ef7-a3f3-c500bae40125 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:16 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-82c2d65b-b56a-4ef7-a3f3-c500bae40125 Jun 30 16:08:16 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:17 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-82c2d65b-b56a-4ef7-a3f3-c500bae40125" returned: 0 in 1.148s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] <== create_volume: return (2774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:08:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.778s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:08:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854db4de-585b-451c-a9ad-56565653a442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82c2d65b-b56a-4ef7-a3f3-c500bae40125', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121084fb-ff8f-4532-9ee5-e8888ff2c733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:17 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Volume volume-82c2d65b-b56a-4ef7-a3f3-c500bae40125 (82c2d65b-b56a-4ef7-a3f3-c500bae40125): created successfully Jun 30 16:08:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121084fb-ff8f-4532-9ee5-e8888ff2c733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Flow 'volume_create_manager' (76357a1b-2253-420b-a7ee-53807d6aae8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:08:17 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-e6ca9665-f9b1-4c2d-a8a3-591f0d3e1464 tempest-GroupsTest-1773125808 None] Created volume successfully. Jun 30 16:08:18 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-e1ab7f9e-4a59-4165-b568-0c07065a1be1 tempest-GroupsTest-1773125808 None] Update group completed successfully. Jun 30 16:08:20 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-d617e97d-4299-4c4d-96b2-3b56218bf658 tempest-GroupsTest-1773125808 None] Update group completed successfully. Jun 30 16:08:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-0476b851-e67b-4c40-b0af-5cdf39a569bf req-3db7704c-59c5-4038-a6ee-f8e4cf02eca5 tempest-ServerActionsTestOtherA-184782683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:08:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-0476b851-e67b-4c40-b0af-5cdf39a569bf req-3db7704c-59c5-4038-a6ee-f8e4cf02eca5 tempest-ServerActionsTestOtherA-184782683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:08:20 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f9620c-4c5d-48d6-993c-c685c400191b]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:08:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-0476b851-e67b-4c40-b0af-5cdf39a569bf req-3db7704c-59c5-4038-a6ee-f8e4cf02eca5 tempest-ServerActionsTestOtherA-184782683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-eaf2b191-edae-46d2-8dfd-4199c22926a4 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:20 devstack sudo[97244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-eaf2b191-edae-46d2-8dfd-4199c22926a4 Jun 30 16:08:20 devstack sudo[97244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:21 devstack sudo[97244]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-0476b851-e67b-4c40-b0af-5cdf39a569bf req-3db7704c-59c5-4038-a6ee-f8e4cf02eca5 tempest-ServerActionsTestOtherA-184782683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-eaf2b191-edae-46d2-8dfd-4199c22926a4" returned: 0 in 0.745s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-0476b851-e67b-4c40-b0af-5cdf39a569bf req-3db7704c-59c5-4038-a6ee-f8e4cf02eca5 tempest-ServerActionsTestOtherA-184782683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.768s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:08:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-0476b851-e67b-4c40-b0af-5cdf39a569bf req-3db7704c-59c5-4038-a6ee-f8e4cf02eca5 tempest-ServerActionsTestOtherA-184782683 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a', 'name': 'volume-eaf2b191-edae-46d2-8dfd-4199c22926a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd4bf3d2a-bed1-431a-90bc-1fda16520d29', 'enforce_multipath': True} {{(pid=93781) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 30 16:08:21 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-0476b851-e67b-4c40-b0af-5cdf39a569bf req-3db7704c-59c5-4038-a6ee-f8e4cf02eca5 tempest-ServerActionsTestOtherA-184782683 None] attachment_update completed successfully. Jun 30 16:08:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] Acquiring lock "cinder-quobyte-82c2d65b-b56a-4ef7-a3f3-c500bae40125" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:08:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] Lock "cinder-quobyte-82c2d65b-b56a-4ef7-a3f3-c500bae40125" acquired by "delete_volume" :: waited 0.023s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:08:21 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecda8c7-2f70-4ded-8e06-7415c156e97f]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:08:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-82c2d65b-b56a-4ef7-a3f3-c500bae40125 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:22 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-82c2d65b-b56a-4ef7-a3f3-c500bae40125 Jun 30 16:08:22 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:22 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-82c2d65b-b56a-4ef7-a3f3-c500bae40125" returned: 0 in 1.047s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-82c2d65b-b56a-4ef7-a3f3-c500bae40125 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:23 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-82c2d65b-b56a-4ef7-a3f3-c500bae40125 Jun 30 16:08:23 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:23 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-82c2d65b-b56a-4ef7-a3f3-c500bae40125" returned: 0 in 0.743s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] Lock "cinder-quobyte-82c2d65b-b56a-4ef7-a3f3-c500bae40125" released by "delete_volume" :: held 1.854s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:08:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] Acquiring lock "cinder-quobyte-b865cd73-8850-4cd1-99b0-c10c20c0ce35" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:08:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] Lock "cinder-quobyte-b865cd73-8850-4cd1-99b0-c10c20c0ce35" acquired by "delete_volume" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:08:23 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e419ab2-4379-4790-832c-d0e9fd7196a7]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:08:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b865cd73-8850-4cd1-99b0-c10c20c0ce35 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:23 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b865cd73-8850-4cd1-99b0-c10c20c0ce35 Jun 30 16:08:23 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:24 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b865cd73-8850-4cd1-99b0-c10c20c0ce35" returned: 0 in 1.201s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b865cd73-8850-4cd1-99b0-c10c20c0ce35 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:25 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b865cd73-8850-4cd1-99b0-c10c20c0ce35 Jun 30 16:08:25 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:25 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b865cd73-8850-4cd1-99b0-c10c20c0ce35" returned: 0 in 0.845s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] Lock "cinder-quobyte-b865cd73-8850-4cd1-99b0-c10c20c0ce35" released by "delete_volume" :: held 2.092s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:08:25 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] Created reservations ['76027efa-370e-4871-9f73-cfc62a5d38fe'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:08:26 devstack cinder-volume[93781]: WARNING cinder.quota [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1690004544 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1690004544, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:08:26 devstack cinder-volume[93781]: WARNING cinder.quota [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1690004544 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1690004544, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:08:26 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] Created reservations ['38d1748f-897a-4ea2-9d8d-9c0352eb2352', '74f1db67-ded3-440a-8709-ae5ac9f96692', 'e3390828-2b38-45ec-bc57-53f42d9b1541', 'b8852001-2332-4bae-930e-491a7839b1b4'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:08:26 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] Created reservations ['d9960d73-cbdf-4bca-b5d7-73bab825e209', 'e5679932-606a-4416-8f3c-4febf820e713', '4621434e-86f1-4d70-b084-682d562cc79d', '2c99c6fa-efdc-4934-a3a1-81bfbee7939a'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:08:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:08:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:08:26 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:08:26 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:08:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:08:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:26 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:08:26 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:27 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.106s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:27 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:08:27 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-9dd21a28-a87c-4e1c-a975-6f8f779d1221 tempest-GroupsTest-1773125808 None] Delete group completed successfully. Jun 30 16:08:29 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:08:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Flow 'volume_create_manager' (20b4fe56-3285-420b-9cd3-b8afa62ea8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:08:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (703e0760-b02f-4130-ac2a-0c77ab16ab02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (703e0760-b02f-4130-ac2a-0c77ab16ab02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-573083461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d95783f-715a-4ef5-aaef-2dcff09b7418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633a930f91c341359328f0ceb3ff4d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:08:29Z,use_quota=True,user_id='065d48fc0760467e9346066e0d4f98d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad9295f5-8b08-48b3-b145-03b8e03765dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad9295f5-8b08-48b3-b145-03b8e03765dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bbe86d9-b211-4cde-93d3-7da5e79b7d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bbe86d9-b211-4cde-93d3-7da5e79b7d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d95783f-715a-4ef5-aaef-2dcff09b7418', 'volume_name': 'volume-0d95783f-715a-4ef5-aaef-2dcff09b7418', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047eaacf-619f-4609-a916-8f526aa6d10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047eaacf-619f-4609-a916-8f526aa6d10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6535d4-0bb9-489b-a0be-dd98ae69312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:29 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Volume 0d95783f-715a-4ef5-aaef-2dcff09b7418: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d95783f-715a-4ef5-aaef-2dcff09b7418', 'volume_size': 1} Jun 30 16:08:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:08:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:08:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-573083461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d95783f-715a-4ef5-aaef-2dcff09b7418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='633a930f91c341359328f0ceb3ff4d87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:08:29Z,use_quota=True,user_id='065d48fc0760467e9346066e0d4f98d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:08:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Creating volume 0d95783f-715a-4ef5-aaef-2dcff09b7418 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:08:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:08:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:08:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:08:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:08:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:08:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:08:29 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:08:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0d95783f-715a-4ef5-aaef-2dcff09b7418 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:29 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0d95783f-715a-4ef5-aaef-2dcff09b7418 1073741824 Jun 30 16:08:29 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:30 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0d95783f-715a-4ef5-aaef-2dcff09b7418 1073741824" returned: 0 in 1.352s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:30 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=72,cinder:INSERT=16,cinder:UPDATE=69,cinder:DELETE=1 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:08:30 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:UPDATE=69,cinder:DELETE=3,cinder:SELECT=67,cinder:INSERT=13 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:08:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0d95783f-715a-4ef5-aaef-2dcff09b7418 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:30 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0d95783f-715a-4ef5-aaef-2dcff09b7418 Jun 30 16:08:30 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:31 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-1881bd31-d008-49ed-8023-45334b536511 req-9a12dbd3-6ec4-44c9-98ed-879a7fea9954 tempest-ServerActionsTestOtherA-184782683 None] Terminate volume connection completed successfully. Jun 30 16:08:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-1881bd31-d008-49ed-8023-45334b536511 req-9a12dbd3-6ec4-44c9-98ed-879a7fea9954 tempest-ServerActionsTestOtherA-184782683 None] Deleting attachment d4bf3d2a-bed1-431a-90bc-1fda16520d29. {{(pid=93781) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 30 16:08:31 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0d95783f-715a-4ef5-aaef-2dcff09b7418" returned: 0 in 0.947s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] <== create_volume: return (2416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:08:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.419s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:08:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6535d4-0bb9-489b-a0be-dd98ae69312d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d95783f-715a-4ef5-aaef-2dcff09b7418', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bd8a49-dee4-498e-8652-fd6b63e35eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:31 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Volume volume-0d95783f-715a-4ef5-aaef-2dcff09b7418 (0d95783f-715a-4ef5-aaef-2dcff09b7418): created successfully Jun 30 16:08:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2bd8a49-dee4-498e-8652-fd6b63e35eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Flow 'volume_create_manager' (20b4fe56-3285-420b-9cd3-b8afa62ea8f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:08:31 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-ba31dc90-c54c-48cb-b863-14f98df7bba5 tempest-AttachVolumeShelveTestJSON-1940926654 None] Created volume successfully. Jun 30 16:08:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:08:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:08:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:08:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:08:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:08:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:08:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:33 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:08:33 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-1881bd31-d008-49ed-8023-45334b536511 req-9950010c-b2a7-4f08-b740-ff31be0dbb4f tempest-ServerActionsTestOtherA-184782683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:08:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-1881bd31-d008-49ed-8023-45334b536511 req-9950010c-b2a7-4f08-b740-ff31be0dbb4f tempest-ServerActionsTestOtherA-184782683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:08:33 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4571d5-6386-4106-9f7e-1f49eaa65b6d]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:08:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-1881bd31-d008-49ed-8023-45334b536511 req-9950010c-b2a7-4f08-b740-ff31be0dbb4f tempest-ServerActionsTestOtherA-184782683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-eaf2b191-edae-46d2-8dfd-4199c22926a4 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:33 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-eaf2b191-edae-46d2-8dfd-4199c22926a4 Jun 30 16:08:33 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:34 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.059s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:34 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:08:34 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:08:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 8 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:08:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:08:34 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-1881bd31-d008-49ed-8023-45334b536511 req-9950010c-b2a7-4f08-b740-ff31be0dbb4f tempest-ServerActionsTestOtherA-184782683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-eaf2b191-edae-46d2-8dfd-4199c22926a4" returned: 0 in 1.038s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-1881bd31-d008-49ed-8023-45334b536511 req-9950010c-b2a7-4f08-b740-ff31be0dbb4f tempest-ServerActionsTestOtherA-184782683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.080s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:08:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-1881bd31-d008-49ed-8023-45334b536511 req-9950010c-b2a7-4f08-b740-ff31be0dbb4f tempest-ServerActionsTestOtherA-184782683 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a', 'name': 'volume-eaf2b191-edae-46d2-8dfd-4199c22926a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '771f05ea-06a4-4218-bfa5-0fd2b71f53d2', 'enforce_multipath': True} {{(pid=93781) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 30 16:08:34 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-1881bd31-d008-49ed-8023-45334b536511 req-9950010c-b2a7-4f08-b740-ff31be0dbb4f tempest-ServerActionsTestOtherA-184782683 None] attachment_update completed successfully. Jun 30 16:08:35 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:08:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Flow 'volume_create_manager' (460d0610-0892-482c-9ceb-159e32a9d1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:08:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c672d19c-09b0-4017-8ca8-71eb27c855c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c672d19c-09b0-4017-8ca8-71eb27c855c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-981036692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3523b5a0-dbf2-4a4c-87f5-a6276dce2efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62e3a2f36da487c9791fc7e69100ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:08:35Z,use_quota=True,user_id='d1fe4dd0243441389bf6f3418a6e7b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72243a1-595e-4e14-a407-39e7a538ac55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72243a1-595e-4e14-a407-39e7a538ac55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2c1170-63ec-4e07-8a08-ae945eb28c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2c1170-63ec-4e07-8a08-ae945eb28c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3523b5a0-dbf2-4a4c-87f5-a6276dce2efc', 'volume_name': 'volume-3523b5a0-dbf2-4a4c-87f5-a6276dce2efc', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f80721e-e232-45bc-a998-8bd750ce2928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f80721e-e232-45bc-a998-8bd750ce2928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f40ea55-9a8b-4a37-8e6e-4ce92fd73da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:35 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Volume 3523b5a0-dbf2-4a4c-87f5-a6276dce2efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3523b5a0-dbf2-4a4c-87f5-a6276dce2efc', 'volume_size': 1} Jun 30 16:08:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:08:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:08:35 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-981036692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3523b5a0-dbf2-4a4c-87f5-a6276dce2efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62e3a2f36da487c9791fc7e69100ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:08:35Z,use_quota=True,user_id='d1fe4dd0243441389bf6f3418a6e7b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:08:35 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Creating volume 3523b5a0-dbf2-4a4c-87f5-a6276dce2efc {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:08:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:08:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:08:35 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:08:35 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:08:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:08:35 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:08:35 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:08:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3523b5a0-dbf2-4a4c-87f5-a6276dce2efc 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:35 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3523b5a0-dbf2-4a4c-87f5-a6276dce2efc 1073741824 Jun 30 16:08:35 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:35 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-480efd91-91e6-4f45-92f8-9aab457cb30f tempest-GroupsV314Test-1785581397 None] Group tempest-GroupsV314Test-Group-17630113: creating Jun 30 16:08:35 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-480efd91-91e6-4f45-92f8-9aab457cb30f tempest-GroupsV314Test-1785581397 None] Group tempest-GroupsV314Test-Group-17630113: created successfully Jun 30 16:08:35 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-480efd91-91e6-4f45-92f8-9aab457cb30f tempest-GroupsV314Test-1785581397 None] Create group completed successfully. Jun 30 16:08:36 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3523b5a0-dbf2-4a4c-87f5-a6276dce2efc 1073741824" returned: 0 in 1.255s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3523b5a0-dbf2-4a4c-87f5-a6276dce2efc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:36 devstack sudo[97941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3523b5a0-dbf2-4a4c-87f5-a6276dce2efc Jun 30 16:08:36 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Flow 'volume_create_manager' (00735eb9-7700-483f-9460-3e92e4119dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0578190f-89b2-49f9-b2a2-4fc44c192bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0578190f-89b2-49f9-b2a2-4fc44c192bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2040086320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e891493e-9992-44a7-bf1c-44d350c8009d,host='devstack@QuobyteHD#QuobyteHD',id=b3b8a592-3127-4edb-9af2-bbbe04de9d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43374f51c5f443f6b519849ac9c4fcaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:08:37Z,use_quota=True,user_id='ddbe772dfa9740b59656dceb463f2fe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cd59f9b-85c7-4cfb-9c46-fd228316ffcb),volume_type_id=0cd59f9b-85c7-4cfb-9c46-fd228316ffcb)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ea50b3-e03f-452a-b07e-6d50fa9f6f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ea50b3-e03f-452a-b07e-6d50fa9f6f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32bf579e-1311-40a6-b7a7-5bc3dce730bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32bf579e-1311-40a6-b7a7-5bc3dce730bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3b8a592-3127-4edb-9af2-bbbe04de9d0d', 'volume_name': 'volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d024eaf-2c07-4d67-9589-1a92c46cb24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d024eaf-2c07-4d67-9589-1a92c46cb24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35b3679c-6004-4906-9a15-a6add51c3560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:37 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Volume b3b8a592-3127-4edb-9af2-bbbe04de9d0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d', 'volume_size': 1} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:08:37 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3523b5a0-dbf2-4a4c-87f5-a6276dce2efc" returned: 0 in 0.966s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] <== create_volume: return (2281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.284s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.130s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e891493e-9992-44a7-bf1c-44d350c8009d,created_at=2026-06-30T14:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2040086320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e891493e-9992-44a7-bf1c-44d350c8009d,host='devstack@QuobyteHD#QuobyteHD',id=b3b8a592-3127-4edb-9af2-bbbe04de9d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43374f51c5f443f6b519849ac9c4fcaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:08:37Z,use_quota=True,user_id='ddbe772dfa9740b59656dceb463f2fe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cd59f9b-85c7-4cfb-9c46-fd228316ffcb),volume_type_id=0cd59f9b-85c7-4cfb-9c46-fd228316ffcb)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Creating volume b3b8a592-3127-4edb-9af2-bbbe04de9d0d {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:08:37 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f40ea55-9a8b-4a37-8e6e-4ce92fd73da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3523b5a0-dbf2-4a4c-87f5-a6276dce2efc', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:37 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d 1073741824 Jun 30 16:08:37 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f54e7f6-d2e5-469d-9127-3e4447fbb124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:37 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Volume volume-3523b5a0-dbf2-4a4c-87f5-a6276dce2efc (3523b5a0-dbf2-4a4c-87f5-a6276dce2efc): created successfully Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f54e7f6-d2e5-469d-9127-3e4447fbb124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Flow 'volume_create_manager' (460d0610-0892-482c-9ceb-159e32a9d1c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:08:37 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-f7c44231-ff5a-46d6-abe2-97e763ffaa2d tempest-ServersNegativeTestJSON-1895063052 None] Created volume successfully. Jun 30 16:08:38 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d 1073741824" returned: 0 in 0.977s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:38 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d Jun 30 16:08:38 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:39 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d" returned: 0 in 0.725s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:08:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:08:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35b3679c-6004-4906-9a15-a6add51c3560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce4badf-7fcc-4c81-8814-a5e3f0b09c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:39 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Volume volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d (b3b8a592-3127-4edb-9af2-bbbe04de9d0d): created successfully Jun 30 16:08:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce4badf-7fcc-4c81-8814-a5e3f0b09c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Flow 'volume_create_manager' (00735eb9-7700-483f-9460-3e92e4119dc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:08:39 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-288a02a0-9a5b-41a2-9c9f-b3a46dffa2ea tempest-GroupsV314Test-1785581397 None] Created volume successfully. Jun 30 16:08:40 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:08:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Flow 'volume_create_manager' (e960ce32-3b48-4d01-8be5-212012ee9014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:08:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0593d6c6-90c1-444e-bed9-fcdd9f78b23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0593d6c6-90c1-444e-bed9-fcdd9f78b23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1022716522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71491b95-a986-46d1-9b49-8c4c73115ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62e3a2f36da487c9791fc7e69100ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:08:40Z,use_quota=True,user_id='d1fe4dd0243441389bf6f3418a6e7b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8914d2f6-039a-4a49-aa9e-a1241760d562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8914d2f6-039a-4a49-aa9e-a1241760d562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (976ace78-b0c0-40c2-ae27-b9955c004f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (976ace78-b0c0-40c2-ae27-b9955c004f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71491b95-a986-46d1-9b49-8c4c73115ae1', 'volume_name': 'volume-71491b95-a986-46d1-9b49-8c4c73115ae1', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c76c32-eb2e-4622-b83b-0ef3589c1e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c76c32-eb2e-4622-b83b-0ef3589c1e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26776654-a090-4b34-b08a-f209aa457fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:40 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Volume 71491b95-a986-46d1-9b49-8c4c73115ae1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71491b95-a986-46d1-9b49-8c4c73115ae1', 'volume_size': 1} Jun 30 16:08:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:08:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:08:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1022716522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71491b95-a986-46d1-9b49-8c4c73115ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62e3a2f36da487c9791fc7e69100ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:08:40Z,use_quota=True,user_id='d1fe4dd0243441389bf6f3418a6e7b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:08:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Creating volume 71491b95-a986-46d1-9b49-8c4c73115ae1 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:08:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:08:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:08:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:08:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:08:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:08:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:08:40 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:08:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71491b95-a986-46d1-9b49-8c4c73115ae1 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:40 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71491b95-a986-46d1-9b49-8c4c73115ae1 1073741824 Jun 30 16:08:40 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:08:41 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71491b95-a986-46d1-9b49-8c4c73115ae1 1073741824" returned: 0 in 1.034s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71491b95-a986-46d1-9b49-8c4c73115ae1 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:41 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71491b95-a986-46d1-9b49-8c4c73115ae1 Jun 30 16:08:41 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:42 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71491b95-a986-46d1-9b49-8c4c73115ae1" returned: 0 in 1.189s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:42 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] <== create_volume: return (2298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:08:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.303s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:08:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.422s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:08:42 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Cloning volume b3b8a592-3127-4edb-9af2-bbbe04de9d0d to volume c3227be2-1788-4e96-8b3d-3884db92e358 Jun 30 16:08:42 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26776654-a090-4b34-b08a-f209aa457fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71491b95-a986-46d1-9b49-8c4c73115ae1', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:42 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76897312-7c61-43e6-b059-80b5b427b317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:08:42 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Creating offline snapshot ca24df3d-01ed-448f-b3ca-dbd9df503b17 of volume b3b8a592-3127-4edb-9af2-bbbe04de9d0d {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:08:42 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Volume volume-71491b95-a986-46d1-9b49-8c4c73115ae1 (71491b95-a986-46d1-9b49-8c4c73115ae1): created successfully Jun 30 16:08:42 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76897312-7c61-43e6-b059-80b5b427b317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:08:42 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Flow 'volume_create_manager' (e960ce32-3b48-4d01-8be5-212012ee9014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:08:42 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[211778cc-b01b-4161-9232-d84277287122]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:08:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:42 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-28e685ff-e6ee-445e-ae4b-406e52dbd195 tempest-ServersNegativeTestJSON-1895063052 None] Created volume successfully. Jun 30 16:08:43 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d Jun 30 16:08:43 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:43 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d" returned: 0 in 1.076s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.ca24df3d-01ed-448f-b3ca-dbd9df503b17 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:43 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1a71564b-3873-44e5-827d-d59d6c4b2bbb tempest-ServersNegativeTestJSON-1895063052 None] Acquiring lock "cinder-71491b95-a986-46d1-9b49-8c4c73115ae1-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:08:43 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.ca24df3d-01ed-448f-b3ca-dbd9df503b17 1G Jun 30 16:08:43 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:43 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1a71564b-3873-44e5-827d-d59d6c4b2bbb tempest-ServersNegativeTestJSON-1895063052 None] Lock "cinder-71491b95-a986-46d1-9b49-8c4c73115ae1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:08:43 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1a71564b-3873-44e5-827d-d59d6c4b2bbb tempest-ServersNegativeTestJSON-1895063052 None] Acquiring lock "cinder-quobyte-71491b95-a986-46d1-9b49-8c4c73115ae1" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:08:43 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1a71564b-3873-44e5-827d-d59d6c4b2bbb tempest-ServersNegativeTestJSON-1895063052 None] Lock "cinder-quobyte-71491b95-a986-46d1-9b49-8c4c73115ae1" acquired by "delete_volume" :: waited 0.019s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:08:44 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e4948b-0861-4dae-9136-a693975ffc41]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:08:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1a71564b-3873-44e5-827d-d59d6c4b2bbb tempest-ServersNegativeTestJSON-1895063052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71491b95-a986-46d1-9b49-8c4c73115ae1 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:44 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71491b95-a986-46d1-9b49-8c4c73115ae1 Jun 30 16:08:44 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:45 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.ca24df3d-01ed-448f-b3ca-dbd9df503b17 1G" returned: 0 in 1.309s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.ca24df3d-01ed-448f-b3ca-dbd9df503b17 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:45 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1a71564b-3873-44e5-827d-d59d6c4b2bbb tempest-ServersNegativeTestJSON-1895063052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71491b95-a986-46d1-9b49-8c4c73115ae1" returned: 0 in 1.184s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1a71564b-3873-44e5-827d-d59d6c4b2bbb tempest-ServersNegativeTestJSON-1895063052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71491b95-a986-46d1-9b49-8c4c73115ae1 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:45 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.ca24df3d-01ed-448f-b3ca-dbd9df503b17 Jun 30 16:08:45 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:45 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71491b95-a986-46d1-9b49-8c4c73115ae1 Jun 30 16:08:45 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:46 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:46 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1a71564b-3873-44e5-827d-d59d6c4b2bbb tempest-ServersNegativeTestJSON-1895063052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71491b95-a986-46d1-9b49-8c4c73115ae1" returned: 0 in 1.106s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.ca24df3d-01ed-448f-b3ca-dbd9df503b17" returned: 0 in 1.155s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:46 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.ca24df3d-01ed-448f-b3ca-dbd9df503b17 is being set with open permissions: ugo+rw: NotImplementedError Jun 30 16:08:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.ca24df3d-01ed-448f-b3ca-dbd9df503b17 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:46 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1a71564b-3873-44e5-827d-d59d6c4b2bbb tempest-ServersNegativeTestJSON-1895063052 None] Lock "cinder-quobyte-71491b95-a986-46d1-9b49-8c4c73115ae1" released by "delete_volume" :: held 2.373s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:08:46 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.ca24df3d-01ed-448f-b3ca-dbd9df503b17 Jun 30 16:08:46 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:46 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-1a71564b-3873-44e5-827d-d59d6c4b2bbb tempest-ServersNegativeTestJSON-1895063052 None] Created reservations ['6f38f2b9-d4c0-4ea7-ab8e-a429a5a64c5e', 'e7da9d4e-4703-4ce3-b440-f24aa604eca3', 'aa7091d9-a416-4171-8c90-ef9dfebe48b3', '6d086fc9-4000-4408-8a64-1e80ee83e06b'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:08:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1a71564b-3873-44e5-827d-d59d6c4b2bbb tempest-ServersNegativeTestJSON-1895063052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:08:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1a71564b-3873-44e5-827d-d59d6c4b2bbb tempest-ServersNegativeTestJSON-1895063052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:08:46 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1a71564b-3873-44e5-827d-d59d6c4b2bbb tempest-ServersNegativeTestJSON-1895063052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:08:46 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1a71564b-3873-44e5-827d-d59d6c4b2bbb tempest-ServersNegativeTestJSON-1895063052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:08:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1a71564b-3873-44e5-827d-d59d6c4b2bbb tempest-ServersNegativeTestJSON-1895063052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:08:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1a71564b-3873-44e5-827d-d59d6c4b2bbb tempest-ServersNegativeTestJSON-1895063052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:46 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:08:46 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:47 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.ca24df3d-01ed-448f-b3ca-dbd9df503b17" returned: 0 in 0.928s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:47 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.info Jun 30 16:08:47 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:47 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-33bf4fa3-e9ea-4114-9341-00e4c7bf7f29 tempest-ServersNegativeTestJSON-1895063052 None] Acquiring lock "cinder-3523b5a0-dbf2-4a4c-87f5-a6276dce2efc-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:08:47 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-33bf4fa3-e9ea-4114-9341-00e4c7bf7f29 tempest-ServersNegativeTestJSON-1895063052 None] Lock "cinder-3523b5a0-dbf2-4a4c-87f5-a6276dce2efc-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:08:47 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-33bf4fa3-e9ea-4114-9341-00e4c7bf7f29 tempest-ServersNegativeTestJSON-1895063052 None] Acquiring lock "cinder-quobyte-3523b5a0-dbf2-4a4c-87f5-a6276dce2efc" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:08:47 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-33bf4fa3-e9ea-4114-9341-00e4c7bf7f29 tempest-ServersNegativeTestJSON-1895063052 None] Lock "cinder-quobyte-3523b5a0-dbf2-4a4c-87f5-a6276dce2efc" acquired by "delete_volume" :: waited 0.037s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:08:47 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[183636fd-33b8-4af3-a688-0e8fef955fcd]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:08:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-33bf4fa3-e9ea-4114-9341-00e4c7bf7f29 tempest-ServersNegativeTestJSON-1895063052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3523b5a0-dbf2-4a4c-87f5-a6276dce2efc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:47 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1a71564b-3873-44e5-827d-d59d6c4b2bbb tempest-ServersNegativeTestJSON-1895063052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.260s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:47 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-1a71564b-3873-44e5-827d-d59d6c4b2bbb tempest-ServersNegativeTestJSON-1895063052 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:08:47 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-1a71564b-3873-44e5-827d-d59d6c4b2bbb tempest-ServersNegativeTestJSON-1895063052 None] Deleted volume successfully. Jun 30 16:08:47 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1a71564b-3873-44e5-827d-d59d6c4b2bbb tempest-ServersNegativeTestJSON-1895063052 None] Lock "cinder-71491b95-a986-46d1-9b49-8c4c73115ae1-delete_volume" released by "delete_volume" :: held 3.956s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:08:48 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3523b5a0-dbf2-4a4c-87f5-a6276dce2efc Jun 30 16:08:48 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:48 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.info" returned: 0 in 0.963s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:48 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.info is being set with open permissions: ugo+rw: NotImplementedError Jun 30 16:08:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:48 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.info Jun 30 16:08:48 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:48 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-33bf4fa3-e9ea-4114-9341-00e4c7bf7f29 tempest-ServersNegativeTestJSON-1895063052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3523b5a0-dbf2-4a4c-87f5-a6276dce2efc" returned: 0 in 1.075s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-33bf4fa3-e9ea-4114-9341-00e4c7bf7f29 tempest-ServersNegativeTestJSON-1895063052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3523b5a0-dbf2-4a4c-87f5-a6276dce2efc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:48 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3523b5a0-dbf2-4a4c-87f5-a6276dce2efc Jun 30 16:08:48 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:49 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.info" returned: 0 in 0.958s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:49 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Acquiring lock "cinder-quobyte-c3227be2-1788-4e96-8b3d-3884db92e358" by "_copy_volume_from_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:08:49 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Lock "cinder-quobyte-c3227be2-1788-4e96-8b3d-3884db92e358" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:08:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] snapshot: ca24df3d-01ed-448f-b3ca-dbd9df503b17, volume: c3227be2-1788-4e96-8b3d-3884db92e358, {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 30 16:08:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:08:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:08:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:08:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:08:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:08:49 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf4e7e8-7d16-476a-a379-02fa0282f2ed]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:08:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.ca24df3d-01ed-448f-b3ca-dbd9df503b17 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:49 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.ca24df3d-01ed-448f-b3ca-dbd9df503b17 Jun 30 16:08:49 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:49 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-33bf4fa3-e9ea-4114-9341-00e4c7bf7f29 tempest-ServersNegativeTestJSON-1895063052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3523b5a0-dbf2-4a4c-87f5-a6276dce2efc" returned: 0 in 0.877s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:49 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-33bf4fa3-e9ea-4114-9341-00e4c7bf7f29 tempest-ServersNegativeTestJSON-1895063052 None] Lock "cinder-quobyte-3523b5a0-dbf2-4a4c-87f5-a6276dce2efc" released by "delete_volume" :: held 2.040s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:08:49 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-33bf4fa3-e9ea-4114-9341-00e4c7bf7f29 tempest-ServersNegativeTestJSON-1895063052 None] Created reservations ['2e85fbaf-d490-4ab0-ad57-c77bfb8cf6c1', 'e38a1c2e-e336-4773-87cc-0f9136f74052', 'dcd239eb-241c-46ec-9100-72916236cbb5', 'f0b7a906-70ad-4db7-a7c5-dd32a26bc227'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:08:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-33bf4fa3-e9ea-4114-9341-00e4c7bf7f29 tempest-ServersNegativeTestJSON-1895063052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:08:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-33bf4fa3-e9ea-4114-9341-00e4c7bf7f29 tempest-ServersNegativeTestJSON-1895063052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:08:50 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-33bf4fa3-e9ea-4114-9341-00e4c7bf7f29 tempest-ServersNegativeTestJSON-1895063052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:08:50 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-33bf4fa3-e9ea-4114-9341-00e4c7bf7f29 tempest-ServersNegativeTestJSON-1895063052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:08:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-33bf4fa3-e9ea-4114-9341-00e4c7bf7f29 tempest-ServersNegativeTestJSON-1895063052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:08:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-33bf4fa3-e9ea-4114-9341-00e4c7bf7f29 tempest-ServersNegativeTestJSON-1895063052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:50 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:08:50 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:50 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.ca24df3d-01ed-448f-b3ca-dbd9df503b17" returned: 0 in 1.187s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:50 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:08:50 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] will copy from snapshot at /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 30 16:08:50 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Creating direct copy from snapshot {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 30 16:08:50 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9bd6a2-0383-48c6-8583-3565fdaaa11c]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:08:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:50 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-63353bab-82ae-4f9e-b6a6-bd17669a4a5a req-253ce7fe-5121-4b4a-a0cc-0e100ddc3d70 tempest-AttachVolumeShelveTestJSON-1940926654 None] No connector for attachment 6665a85e-ea23-4bd0-8d92-229ac1dcaad4; skipping storage backend terminate_connection call. {{(pid=93781) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 30 16:08:50 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-63353bab-82ae-4f9e-b6a6-bd17669a4a5a req-253ce7fe-5121-4b4a-a0cc-0e100ddc3d70 tempest-AttachVolumeShelveTestJSON-1940926654 None] Deleting attachment 6665a85e-ea23-4bd0-8d92-229ac1dcaad4. {{(pid=93781) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 30 16:08:50 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d Jun 30 16:08:50 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:51 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-33bf4fa3-e9ea-4114-9341-00e4c7bf7f29 tempest-ServersNegativeTestJSON-1895063052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.085s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:51 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-33bf4fa3-e9ea-4114-9341-00e4c7bf7f29 tempest-ServersNegativeTestJSON-1895063052 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:08:51 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-33bf4fa3-e9ea-4114-9341-00e4c7bf7f29 tempest-ServersNegativeTestJSON-1895063052 None] Deleted volume successfully. Jun 30 16:08:51 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-33bf4fa3-e9ea-4114-9341-00e4c7bf7f29 tempest-ServersNegativeTestJSON-1895063052 None] Lock "cinder-3523b5a0-dbf2-4a4c-87f5-a6276dce2efc-delete_volume" released by "delete_volume" :: held 3.592s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:08:51 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d" returned: 0 in 1.033s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:51 devstack cinder-volume[93781]: DEBUG cinder.utils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Path /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c3227be2-1788-4e96-8b3d-3884db92e358 not found in is_blk_device check {{(pid=93781) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 30 16:08:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c3227be2-1788-4e96-8b3d-3884db92e358 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:51 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c3227be2-1788-4e96-8b3d-3884db92e358 Jun 30 16:08:51 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:08:59 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Jun 30 16:08:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c3227be2-1788-4e96-8b3d-3884db92e358" returned: 0 in 8.085s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:08:59 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c02444b-3fe0-4109-9a69-fad6fc2a1797]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:08:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:08:59 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d Jun 30 16:08:59 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:00 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d" returned: 0 in 0.895s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:00 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Image conversion details: src /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d, size 1024.00 MB, duration 8.09 sec, destination /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c3227be2-1788-4e96-8b3d-3884db92e358 {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:09:00 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Converted 1024.00 MB image at 126.64 MB/s Jun 30 16:09:00 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c3227be2-1788-4e96-8b3d-3884db92e358 is being set with open permissions: ugo+rw: NotImplementedError Jun 30 16:09:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c3227be2-1788-4e96-8b3d-3884db92e358 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:00 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c3227be2-1788-4e96-8b3d-3884db92e358 Jun 30 16:09:00 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:00 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=30,cinder:INSERT=9,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:09:01 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=33,cinder:DELETE=5,cinder:UPDATE=28,cinder:INSERT=5 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:09:01 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c3227be2-1788-4e96-8b3d-3884db92e358" returned: 0 in 0.713s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Lock "cinder-quobyte-c3227be2-1788-4e96-8b3d-3884db92e358" released by "_copy_volume_from_snapshot" :: held 12.040s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:09:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Acquiring lock "cinder-quobyte-ca24df3d-01ed-448f-b3ca-dbd9df503b17" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:09:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Lock "cinder-quobyte-ca24df3d-01ed-448f-b3ca-dbd9df503b17" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:09:01 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Deleting offline snapshot ca24df3d-01ed-448f-b3ca-dbd9df503b17 of volume b3b8a592-3127-4edb-9af2-bbbe04de9d0d {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:09:01 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] snapshot_file for this snap is: volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.ca24df3d-01ed-448f-b3ca-dbd9df503b17 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:09:01 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[5900f34c-cfc9-457a-bd0c-13f63ad319bf]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:09:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.ca24df3d-01ed-448f-b3ca-dbd9df503b17 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:01 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.ca24df3d-01ed-448f-b3ca-dbd9df503b17 Jun 30 16:09:01 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:02 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.ca24df3d-01ed-448f-b3ca-dbd9df503b17" returned: 0 in 0.775s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:09:02 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[872b86b9-32fe-402e-8811-6bcd3ce95bc1]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:09:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:02 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d Jun 30 16:09:02 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:03 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d" returned: 0 in 0.812s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.ca24df3d-01ed-448f-b3ca-dbd9df503b17 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:03 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.ca24df3d-01ed-448f-b3ca-dbd9df503b17 Jun 30 16:09:03 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:04 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.ca24df3d-01ed-448f-b3ca-dbd9df503b17" returned: 0 in 1.056s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.ca24df3d-01ed-448f-b3ca-dbd9df503b17 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:04 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.ca24df3d-01ed-448f-b3ca-dbd9df503b17 Jun 30 16:09:04 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:05 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d.ca24df3d-01ed-448f-b3ca-dbd9df503b17" returned: 0 in 1.160s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:05 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Lock "cinder-quobyte-ca24df3d-01ed-448f-b3ca-dbd9df503b17" released by "_delete_snapshot" :: held 3.953s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:09:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.871s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:09:05 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-7d17457c-6c4e-44af-ac8b-1fe00693f67e tempest-GroupsV314Test-1785581397 None] Create group from source-group-e891493e-9992-44a7-bf1c-44d350c8009d completed successfully. Jun 30 16:09:07 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-926ef613-cf0d-45e4-b89b-a3c5ede45469 tempest-GroupsV314Test-1785581397 None] Acquiring lock "cinder-quobyte-c3227be2-1788-4e96-8b3d-3884db92e358" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:09:07 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-926ef613-cf0d-45e4-b89b-a3c5ede45469 tempest-GroupsV314Test-1785581397 None] Lock "cinder-quobyte-c3227be2-1788-4e96-8b3d-3884db92e358" acquired by "delete_volume" :: waited 0.022s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:09:07 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[46baf23d-e1f0-435a-8f21-f3e2016fc55e]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:09:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-926ef613-cf0d-45e4-b89b-a3c5ede45469 tempest-GroupsV314Test-1785581397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c3227be2-1788-4e96-8b3d-3884db92e358 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:07 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c3227be2-1788-4e96-8b3d-3884db92e358 Jun 30 16:09:07 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:08 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-16e0c24e-4e6b-476d-92cd-0d2af9df5fb9 req-49644d02-1c3b-4c75-942c-a6ce8bc74635 tempest-ServerActionsTestOtherA-184782683 None] Terminate volume connection completed successfully. Jun 30 16:09:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-16e0c24e-4e6b-476d-92cd-0d2af9df5fb9 req-49644d02-1c3b-4c75-942c-a6ce8bc74635 tempest-ServerActionsTestOtherA-184782683 None] Deleting attachment 771f05ea-06a4-4218-bfa5-0fd2b71f53d2. {{(pid=93781) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 30 16:09:08 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-926ef613-cf0d-45e4-b89b-a3c5ede45469 tempest-GroupsV314Test-1785581397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c3227be2-1788-4e96-8b3d-3884db92e358" returned: 0 in 1.223s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-926ef613-cf0d-45e4-b89b-a3c5ede45469 tempest-GroupsV314Test-1785581397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c3227be2-1788-4e96-8b3d-3884db92e358 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:08 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c3227be2-1788-4e96-8b3d-3884db92e358 Jun 30 16:09:08 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:09 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-926ef613-cf0d-45e4-b89b-a3c5ede45469 tempest-GroupsV314Test-1785581397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c3227be2-1788-4e96-8b3d-3884db92e358" returned: 0 in 0.750s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-926ef613-cf0d-45e4-b89b-a3c5ede45469 tempest-GroupsV314Test-1785581397 None] Lock "cinder-quobyte-c3227be2-1788-4e96-8b3d-3884db92e358" released by "delete_volume" :: held 2.025s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:09:09 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-926ef613-cf0d-45e4-b89b-a3c5ede45469 tempest-GroupsV314Test-1785581397 None] Created reservations ['58980e7b-9191-400b-b142-2d010781d89a'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:09:09 devstack cinder-volume[93781]: WARNING cinder.quota [None req-926ef613-cf0d-45e4-b89b-a3c5ede45469 tempest-GroupsV314Test-1785581397 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1575139379 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1575139379, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:09:09 devstack cinder-volume[93781]: WARNING cinder.quota [None req-926ef613-cf0d-45e4-b89b-a3c5ede45469 tempest-GroupsV314Test-1785581397 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1575139379 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1575139379, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:09:09 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-926ef613-cf0d-45e4-b89b-a3c5ede45469 tempest-GroupsV314Test-1785581397 None] Created reservations ['29baab67-0d28-4cc6-a542-700f888308e0', '3ad5e563-6512-4539-bfd3-5d2f7f6549d6', '6682213a-9b58-4f37-8b22-ab134a05fe5c', '57e8470e-ad89-4bb5-a8c2-a838e69453b4'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:09:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-926ef613-cf0d-45e4-b89b-a3c5ede45469 tempest-GroupsV314Test-1785581397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:09:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-926ef613-cf0d-45e4-b89b-a3c5ede45469 tempest-GroupsV314Test-1785581397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:09:09 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-926ef613-cf0d-45e4-b89b-a3c5ede45469 tempest-GroupsV314Test-1785581397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:09:09 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-926ef613-cf0d-45e4-b89b-a3c5ede45469 tempest-GroupsV314Test-1785581397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:09:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-926ef613-cf0d-45e4-b89b-a3c5ede45469 tempest-GroupsV314Test-1785581397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:09:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-926ef613-cf0d-45e4-b89b-a3c5ede45469 tempest-GroupsV314Test-1785581397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:09 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:09:09 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:10 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a472716d-d622-4c3b-85bd-a0982ff04c67 tempest-GroupsV314Test-1785581397 None] Acquiring lock "cinder-quobyte-b3b8a592-3127-4edb-9af2-bbbe04de9d0d" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:09:10 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a472716d-d622-4c3b-85bd-a0982ff04c67 tempest-GroupsV314Test-1785581397 None] Lock "cinder-quobyte-b3b8a592-3127-4edb-9af2-bbbe04de9d0d" acquired by "delete_volume" :: waited 0.037s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:09:10 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e43512-dece-4657-9d82-59d975cb8f2d]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:09:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a472716d-d622-4c3b-85bd-a0982ff04c67 tempest-GroupsV314Test-1785581397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:10 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d Jun 30 16:09:10 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:10 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-926ef613-cf0d-45e4-b89b-a3c5ede45469 tempest-GroupsV314Test-1785581397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.089s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:10 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-926ef613-cf0d-45e4-b89b-a3c5ede45469 tempest-GroupsV314Test-1785581397 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:09:10 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-926ef613-cf0d-45e4-b89b-a3c5ede45469 tempest-GroupsV314Test-1785581397 None] Delete group completed successfully. Jun 30 16:09:11 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a472716d-d622-4c3b-85bd-a0982ff04c67 tempest-GroupsV314Test-1785581397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d" returned: 0 in 0.905s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a472716d-d622-4c3b-85bd-a0982ff04c67 tempest-GroupsV314Test-1785581397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:11 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d Jun 30 16:09:11 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:12 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a472716d-d622-4c3b-85bd-a0982ff04c67 tempest-GroupsV314Test-1785581397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b3b8a592-3127-4edb-9af2-bbbe04de9d0d" returned: 0 in 0.964s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a472716d-d622-4c3b-85bd-a0982ff04c67 tempest-GroupsV314Test-1785581397 None] Lock "cinder-quobyte-b3b8a592-3127-4edb-9af2-bbbe04de9d0d" released by "delete_volume" :: held 1.979s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:09:12 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-a472716d-d622-4c3b-85bd-a0982ff04c67 tempest-GroupsV314Test-1785581397 None] Created reservations ['a4334bb4-b311-4857-a34c-d16fec6afecf'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:09:12 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-a472716d-d622-4c3b-85bd-a0982ff04c67 tempest-GroupsV314Test-1785581397 None] Created reservations ['cb43d76e-c5f3-46dd-98fc-f809190b54eb', '1bad69ad-a8e8-4561-96d8-b74737805434', '722272f5-8d47-470a-804e-f80423a8de2a', '01b6ce5c-c804-407f-b880-68d6b661d5fe'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:09:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a472716d-d622-4c3b-85bd-a0982ff04c67 tempest-GroupsV314Test-1785581397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:09:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a472716d-d622-4c3b-85bd-a0982ff04c67 tempest-GroupsV314Test-1785581397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:09:12 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a472716d-d622-4c3b-85bd-a0982ff04c67 tempest-GroupsV314Test-1785581397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:09:12 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a472716d-d622-4c3b-85bd-a0982ff04c67 tempest-GroupsV314Test-1785581397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:09:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a472716d-d622-4c3b-85bd-a0982ff04c67 tempest-GroupsV314Test-1785581397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:09:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a472716d-d622-4c3b-85bd-a0982ff04c67 tempest-GroupsV314Test-1785581397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:12 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:09:12 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:13 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a472716d-d622-4c3b-85bd-a0982ff04c67 tempest-GroupsV314Test-1785581397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.032s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:13 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a472716d-d622-4c3b-85bd-a0982ff04c67 tempest-GroupsV314Test-1785581397 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:09:13 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-a472716d-d622-4c3b-85bd-a0982ff04c67 tempest-GroupsV314Test-1785581397 None] Delete group completed successfully. Jun 30 16:09:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-acf9c6ef-e831-4b40-8f46-8ff4823573ce tempest-ServerActionsTestOtherA-184782683 None] Acquiring lock "cinder-eaf2b191-edae-46d2-8dfd-4199c22926a4-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:09:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-acf9c6ef-e831-4b40-8f46-8ff4823573ce tempest-ServerActionsTestOtherA-184782683 None] Lock "cinder-eaf2b191-edae-46d2-8dfd-4199c22926a4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:09:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-acf9c6ef-e831-4b40-8f46-8ff4823573ce tempest-ServerActionsTestOtherA-184782683 None] Acquiring lock "cinder-quobyte-eaf2b191-edae-46d2-8dfd-4199c22926a4" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:09:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-acf9c6ef-e831-4b40-8f46-8ff4823573ce tempest-ServerActionsTestOtherA-184782683 None] Lock "cinder-quobyte-eaf2b191-edae-46d2-8dfd-4199c22926a4" acquired by "delete_volume" :: waited 0.021s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:09:20 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0fa272-1a47-4bdb-ac76-ff166148b793]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:09:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-acf9c6ef-e831-4b40-8f46-8ff4823573ce tempest-ServerActionsTestOtherA-184782683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-eaf2b191-edae-46d2-8dfd-4199c22926a4 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:20 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-eaf2b191-edae-46d2-8dfd-4199c22926a4 Jun 30 16:09:20 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:21 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-acf9c6ef-e831-4b40-8f46-8ff4823573ce tempest-ServerActionsTestOtherA-184782683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-eaf2b191-edae-46d2-8dfd-4199c22926a4" returned: 0 in 1.057s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-acf9c6ef-e831-4b40-8f46-8ff4823573ce tempest-ServerActionsTestOtherA-184782683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-eaf2b191-edae-46d2-8dfd-4199c22926a4 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:21 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-eaf2b191-edae-46d2-8dfd-4199c22926a4 Jun 30 16:09:21 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:22 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-acf9c6ef-e831-4b40-8f46-8ff4823573ce tempest-ServerActionsTestOtherA-184782683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-eaf2b191-edae-46d2-8dfd-4199c22926a4" returned: 0 in 0.989s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:22 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-acf9c6ef-e831-4b40-8f46-8ff4823573ce tempest-ServerActionsTestOtherA-184782683 None] Lock "cinder-quobyte-eaf2b191-edae-46d2-8dfd-4199c22926a4" released by "delete_volume" :: held 2.135s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:09:23 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-acf9c6ef-e831-4b40-8f46-8ff4823573ce tempest-ServerActionsTestOtherA-184782683 None] Created reservations ['6c33bf26-04b3-4bae-b955-461f6234690c', '3f0b6c5e-b5c9-49db-9285-423b252c1169', '610d580b-ad73-4462-8d3d-e004a8f653bd', 'bc123a46-073c-43c6-929b-06a1391491b1'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:09:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-acf9c6ef-e831-4b40-8f46-8ff4823573ce tempest-ServerActionsTestOtherA-184782683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:09:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-acf9c6ef-e831-4b40-8f46-8ff4823573ce tempest-ServerActionsTestOtherA-184782683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:09:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-acf9c6ef-e831-4b40-8f46-8ff4823573ce tempest-ServerActionsTestOtherA-184782683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:09:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-acf9c6ef-e831-4b40-8f46-8ff4823573ce tempest-ServerActionsTestOtherA-184782683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:09:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-acf9c6ef-e831-4b40-8f46-8ff4823573ce tempest-ServerActionsTestOtherA-184782683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:09:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-acf9c6ef-e831-4b40-8f46-8ff4823573ce tempest-ServerActionsTestOtherA-184782683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:23 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:09:23 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:24 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-acf9c6ef-e831-4b40-8f46-8ff4823573ce tempest-ServerActionsTestOtherA-184782683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.184s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:24 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-acf9c6ef-e831-4b40-8f46-8ff4823573ce tempest-ServerActionsTestOtherA-184782683 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:09:24 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-acf9c6ef-e831-4b40-8f46-8ff4823573ce tempest-ServerActionsTestOtherA-184782683 None] Deleted volume successfully. Jun 30 16:09:24 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-acf9c6ef-e831-4b40-8f46-8ff4823573ce tempest-ServerActionsTestOtherA-184782683 None] Lock "cinder-eaf2b191-edae-46d2-8dfd-4199c22926a4-delete_volume" released by "delete_volume" :: held 3.950s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:09:31 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:09:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Flow 'volume_create_manager' (b5052876-8770-46dc-9605-aaed5c9e321b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:09:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ccdd212-7b99-40e2-9f41-b1a445387736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:09:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ccdd212-7b99-40e2-9f41-b1a445387736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-659740119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0196cd8c-c8ec-4d90-8c6d-b2f309ca7589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a42cf86765734bb89a6ba0956a22d3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:09:31Z,use_quota=True,user_id='8760a767a51b49479106e5a83bbae433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:09:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2792d169-945a-4b93-a1e2-1a0718cfc942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:09:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2792d169-945a-4b93-a1e2-1a0718cfc942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:09:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f99703-fd93-45c6-9fa1-dc030ce614e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:09:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f99703-fd93-45c6-9fa1-dc030ce614e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0196cd8c-c8ec-4d90-8c6d-b2f309ca7589', 'volume_name': 'volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:09:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63ca635-db77-44ed-9bc3-1a736b5f5500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:09:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63ca635-db77-44ed-9bc3-1a736b5f5500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:09:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06e04b4-7ef7-4f95-ba50-299501419e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:09:31 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Volume 0196cd8c-c8ec-4d90-8c6d-b2f309ca7589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589', 'volume_size': 1} Jun 30 16:09:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:09:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:09:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-659740119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0196cd8c-c8ec-4d90-8c6d-b2f309ca7589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a42cf86765734bb89a6ba0956a22d3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:09:31Z,use_quota=True,user_id='8760a767a51b49479106e5a83bbae433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:09:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Creating volume 0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:09:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:09:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:09:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:09:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:09:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:09:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:09:31 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:09:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:31 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 1073741824 Jun 30 16:09:31 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:32 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 1073741824" returned: 0 in 0.977s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:32 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 Jun 30 16:09:32 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:33 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:09:33 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:33 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589" returned: 0 in 0.700s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06e04b4-7ef7-4f95-ba50-299501419e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2d902f-70a7-48b7-93b6-5bbf4fb39a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:09:33 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Volume volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 (0196cd8c-c8ec-4d90-8c6d-b2f309ca7589): created successfully Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2d902f-70a7-48b7-93b6-5bbf4fb39a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Flow 'volume_create_manager' (b5052876-8770-46dc-9605-aaed5c9e321b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:09:33 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-faa14af5-dbba-4df9-a8ba-fdfa91866076 tempest-SnapshotsActionsTest-500803998 None] Created volume successfully. Jun 30 16:09:33 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.815s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 8 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4e35e0c4-763a-4579-aa50-71176f2af922 tempest-SnapshotsActionsTest-500803998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4e35e0c4-763a-4579-aa50-71176f2af922 tempest-SnapshotsActionsTest-500803998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-4e35e0c4-763a-4579-aa50-71176f2af922 tempest-SnapshotsActionsTest-500803998 None] Creating offline snapshot 0a16da40-b707-4e31-a210-75f0a0ce7917 of volume 0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[635907dd-e13e-42e4-b83d-bf96d44689fe]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:09:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4e35e0c4-763a-4579-aa50-71176f2af922 tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:34 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 Jun 30 16:09:34 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:34 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4e35e0c4-763a-4579-aa50-71176f2af922 tempest-SnapshotsActionsTest-500803998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589" returned: 0 in 0.930s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4e35e0c4-763a-4579-aa50-71176f2af922 tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:34 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 1G Jun 30 16:09:34 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:35 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4e35e0c4-763a-4579-aa50-71176f2af922 tempest-SnapshotsActionsTest-500803998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 1G" returned: 0 in 1.002s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4e35e0c4-763a-4579-aa50-71176f2af922 tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:35 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 Jun 30 16:09:35 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:36 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4e35e0c4-763a-4579-aa50-71176f2af922 tempest-SnapshotsActionsTest-500803998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917" returned: 0 in 0.719s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:36 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-4e35e0c4-763a-4579-aa50-71176f2af922 tempest-SnapshotsActionsTest-500803998 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 is being set with open permissions: ugo+rw Jun 30 16:09:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4e35e0c4-763a-4579-aa50-71176f2af922 tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:36 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 Jun 30 16:09:36 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:37 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4e35e0c4-763a-4579-aa50-71176f2af922 tempest-SnapshotsActionsTest-500803998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917" returned: 0 in 0.676s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4e35e0c4-763a-4579-aa50-71176f2af922 tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:37 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.info Jun 30 16:09:37 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:38 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4e35e0c4-763a-4579-aa50-71176f2af922 tempest-SnapshotsActionsTest-500803998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.info" returned: 0 in 0.721s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:38 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-4e35e0c4-763a-4579-aa50-71176f2af922 tempest-SnapshotsActionsTest-500803998 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.info is being set with open permissions: ugo+rw Jun 30 16:09:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4e35e0c4-763a-4579-aa50-71176f2af922 tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:38 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.info Jun 30 16:09:38 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:38 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4e35e0c4-763a-4579-aa50-71176f2af922 tempest-SnapshotsActionsTest-500803998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.info" returned: 0 in 0.727s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4e35e0c4-763a-4579-aa50-71176f2af922 tempest-SnapshotsActionsTest-500803998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.896s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:09:38 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-4e35e0c4-763a-4579-aa50-71176f2af922 tempest-SnapshotsActionsTest-500803998 None] Create snapshot completed successfully Jun 30 16:09:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b917f0a6-5876-4a90-9413-0c328582b426 tempest-SnapshotsActionsTest-500803998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:09:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b917f0a6-5876-4a90-9413-0c328582b426 tempest-SnapshotsActionsTest-500803998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:09:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-b917f0a6-5876-4a90-9413-0c328582b426 tempest-SnapshotsActionsTest-500803998 None] Creating offline snapshot cbdde677-c1c5-4e43-a4b1-7e69796881d1 of volume 0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:09:39 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[d391c0ac-cf8e-47b0-b2c8-bfcf133733de]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:09:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b917f0a6-5876-4a90-9413-0c328582b426 tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:40 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 Jun 30 16:09:40 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:41 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b917f0a6-5876-4a90-9413-0c328582b426 tempest-SnapshotsActionsTest-500803998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917" returned: 0 in 1.233s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-b917f0a6-5876-4a90-9413-0c328582b426 tempest-SnapshotsActionsTest-500803998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:09:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b917f0a6-5876-4a90-9413-0c328582b426 tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.cbdde677-c1c5-4e43-a4b1-7e69796881d1 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:41 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.cbdde677-c1c5-4e43-a4b1-7e69796881d1 1G Jun 30 16:09:41 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:42 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b917f0a6-5876-4a90-9413-0c328582b426 tempest-SnapshotsActionsTest-500803998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.cbdde677-c1c5-4e43-a4b1-7e69796881d1 1G" returned: 0 in 1.534s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b917f0a6-5876-4a90-9413-0c328582b426 tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.cbdde677-c1c5-4e43-a4b1-7e69796881d1 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:42 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.cbdde677-c1c5-4e43-a4b1-7e69796881d1 Jun 30 16:09:42 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:43 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b917f0a6-5876-4a90-9413-0c328582b426 tempest-SnapshotsActionsTest-500803998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.cbdde677-c1c5-4e43-a4b1-7e69796881d1" returned: 0 in 0.821s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:43 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-b917f0a6-5876-4a90-9413-0c328582b426 tempest-SnapshotsActionsTest-500803998 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.cbdde677-c1c5-4e43-a4b1-7e69796881d1 is being set with open permissions: ugo+rw Jun 30 16:09:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b917f0a6-5876-4a90-9413-0c328582b426 tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.cbdde677-c1c5-4e43-a4b1-7e69796881d1 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:43 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.cbdde677-c1c5-4e43-a4b1-7e69796881d1 Jun 30 16:09:43 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:44 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b917f0a6-5876-4a90-9413-0c328582b426 tempest-SnapshotsActionsTest-500803998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.cbdde677-c1c5-4e43-a4b1-7e69796881d1" returned: 0 in 0.859s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b917f0a6-5876-4a90-9413-0c328582b426 tempest-SnapshotsActionsTest-500803998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.607s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:09:44 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-b917f0a6-5876-4a90-9413-0c328582b426 tempest-SnapshotsActionsTest-500803998 None] Create snapshot completed successfully Jun 30 16:09:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-986701f4-2ddb-4705-be3d-2569c8dc3749 tempest-SnapshotsActionsTest-814560929 None] Acquiring lock "cinder-cbdde677-c1c5-4e43-a4b1-7e69796881d1-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:09:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-986701f4-2ddb-4705-be3d-2569c8dc3749 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-cbdde677-c1c5-4e43-a4b1-7e69796881d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:09:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-986701f4-2ddb-4705-be3d-2569c8dc3749 tempest-SnapshotsActionsTest-814560929 None] Acquiring lock "cinder-quobyte-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:09:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-986701f4-2ddb-4705-be3d-2569c8dc3749 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-quobyte-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:09:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-986701f4-2ddb-4705-be3d-2569c8dc3749 tempest-SnapshotsActionsTest-814560929 None] Acquiring lock "cinder-quobyte-cbdde677-c1c5-4e43-a4b1-7e69796881d1" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:09:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-986701f4-2ddb-4705-be3d-2569c8dc3749 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-quobyte-cbdde677-c1c5-4e43-a4b1-7e69796881d1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:09:45 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-986701f4-2ddb-4705-be3d-2569c8dc3749 tempest-SnapshotsActionsTest-814560929 None] Deleting offline snapshot cbdde677-c1c5-4e43-a4b1-7e69796881d1 of volume 0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:09:45 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-986701f4-2ddb-4705-be3d-2569c8dc3749 tempest-SnapshotsActionsTest-814560929 None] snapshot_file for this snap is: volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.cbdde677-c1c5-4e43-a4b1-7e69796881d1 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:09:45 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b0ab4a-8c03-44e2-bde9-39a5fd76f05d]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:09:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-986701f4-2ddb-4705-be3d-2569c8dc3749 tempest-SnapshotsActionsTest-814560929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.cbdde677-c1c5-4e43-a4b1-7e69796881d1 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:45 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.cbdde677-c1c5-4e43-a4b1-7e69796881d1 Jun 30 16:09:45 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:46 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-986701f4-2ddb-4705-be3d-2569c8dc3749 tempest-SnapshotsActionsTest-814560929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.cbdde677-c1c5-4e43-a4b1-7e69796881d1" returned: 0 in 0.880s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:46 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-986701f4-2ddb-4705-be3d-2569c8dc3749 tempest-SnapshotsActionsTest-814560929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:09:46 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f86c62d-6377-4bd7-82a5-cf3698323a10]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:09:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-986701f4-2ddb-4705-be3d-2569c8dc3749 tempest-SnapshotsActionsTest-814560929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:46 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 Jun 30 16:09:46 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:47 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-986701f4-2ddb-4705-be3d-2569c8dc3749 tempest-SnapshotsActionsTest-814560929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917" returned: 0 in 0.855s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-986701f4-2ddb-4705-be3d-2569c8dc3749 tempest-SnapshotsActionsTest-814560929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:09:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-986701f4-2ddb-4705-be3d-2569c8dc3749 tempest-SnapshotsActionsTest-814560929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.cbdde677-c1c5-4e43-a4b1-7e69796881d1 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:47 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.cbdde677-c1c5-4e43-a4b1-7e69796881d1 Jun 30 16:09:47 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:47 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-986701f4-2ddb-4705-be3d-2569c8dc3749 tempest-SnapshotsActionsTest-814560929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.cbdde677-c1c5-4e43-a4b1-7e69796881d1" returned: 0 in 0.911s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-986701f4-2ddb-4705-be3d-2569c8dc3749 tempest-SnapshotsActionsTest-814560929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.cbdde677-c1c5-4e43-a4b1-7e69796881d1 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:48 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.cbdde677-c1c5-4e43-a4b1-7e69796881d1 Jun 30 16:09:48 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:48 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-986701f4-2ddb-4705-be3d-2569c8dc3749 tempest-SnapshotsActionsTest-814560929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.cbdde677-c1c5-4e43-a4b1-7e69796881d1" returned: 0 in 0.826s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-986701f4-2ddb-4705-be3d-2569c8dc3749 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-quobyte-cbdde677-c1c5-4e43-a4b1-7e69796881d1" released by "_delete_snapshot" :: held 3.613s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:09:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-986701f4-2ddb-4705-be3d-2569c8dc3749 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-quobyte-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589" released by "delete_snapshot" :: held 3.646s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:09:48 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-986701f4-2ddb-4705-be3d-2569c8dc3749 tempest-SnapshotsActionsTest-814560929 None] Created reservations ['e90456b7-9e66-45a7-9806-4d4f2e7d4798', '7c0a2d0b-8ac3-4234-a2d5-9f52f1bc2826', '63257d40-556b-46b1-abb3-c9d2d5ce21ad', '20baef1a-47ad-41b7-94f2-d80c0ecdeed1'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:09:49 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-986701f4-2ddb-4705-be3d-2569c8dc3749 tempest-SnapshotsActionsTest-814560929 None] Delete snapshot completed successfully. Jun 30 16:09:49 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-986701f4-2ddb-4705-be3d-2569c8dc3749 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-cbdde677-c1c5-4e43-a4b1-7e69796881d1-delete_snapshot" released by "delete_snapshot" :: held 3.903s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:09:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f2a550fb-b352-4393-94fe-36aeeca436b1 tempest-AttachVolumeShelveTestJSON-1940926654 None] Acquiring lock "cinder-0d95783f-715a-4ef5-aaef-2dcff09b7418-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:09:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f2a550fb-b352-4393-94fe-36aeeca436b1 tempest-AttachVolumeShelveTestJSON-1940926654 None] Lock "cinder-0d95783f-715a-4ef5-aaef-2dcff09b7418-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:09:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f2a550fb-b352-4393-94fe-36aeeca436b1 tempest-AttachVolumeShelveTestJSON-1940926654 None] Acquiring lock "cinder-quobyte-0d95783f-715a-4ef5-aaef-2dcff09b7418" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:09:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f2a550fb-b352-4393-94fe-36aeeca436b1 tempest-AttachVolumeShelveTestJSON-1940926654 None] Lock "cinder-quobyte-0d95783f-715a-4ef5-aaef-2dcff09b7418" acquired by "delete_volume" :: waited 0.026s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:09:50 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab2a4e6-55cd-4678-af25-dd694dc99eac]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:09:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f2a550fb-b352-4393-94fe-36aeeca436b1 tempest-AttachVolumeShelveTestJSON-1940926654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0d95783f-715a-4ef5-aaef-2dcff09b7418 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-22c1dbb6-d42f-49f6-94f1-b9acebd35cdc tempest-SnapshotsActionsTest-500803998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:09:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-22c1dbb6-d42f-49f6-94f1-b9acebd35cdc tempest-SnapshotsActionsTest-500803998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:09:50 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-22c1dbb6-d42f-49f6-94f1-b9acebd35cdc tempest-SnapshotsActionsTest-500803998 None] Creating offline snapshot 181f203e-af06-4b52-8a40-77af188afc2d of volume 0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:09:50 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0d95783f-715a-4ef5-aaef-2dcff09b7418 Jun 30 16:09:50 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:50 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b1c734-ead8-4079-8d70-e321fa220ade]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:09:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-22c1dbb6-d42f-49f6-94f1-b9acebd35cdc tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:50 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 Jun 30 16:09:50 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:51 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f2a550fb-b352-4393-94fe-36aeeca436b1 tempest-AttachVolumeShelveTestJSON-1940926654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0d95783f-715a-4ef5-aaef-2dcff09b7418" returned: 0 in 1.621s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f2a550fb-b352-4393-94fe-36aeeca436b1 tempest-AttachVolumeShelveTestJSON-1940926654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0d95783f-715a-4ef5-aaef-2dcff09b7418 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:51 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0d95783f-715a-4ef5-aaef-2dcff09b7418 Jun 30 16:09:51 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:52 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-22c1dbb6-d42f-49f6-94f1-b9acebd35cdc tempest-SnapshotsActionsTest-500803998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917" returned: 0 in 1.551s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:52 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-22c1dbb6-d42f-49f6-94f1-b9acebd35cdc tempest-SnapshotsActionsTest-500803998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:09:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-22c1dbb6-d42f-49f6-94f1-b9acebd35cdc tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.181f203e-af06-4b52-8a40-77af188afc2d 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:52 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.181f203e-af06-4b52-8a40-77af188afc2d 1G Jun 30 16:09:52 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:53 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f2a550fb-b352-4393-94fe-36aeeca436b1 tempest-AttachVolumeShelveTestJSON-1940926654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0d95783f-715a-4ef5-aaef-2dcff09b7418" returned: 0 in 1.353s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:53 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f2a550fb-b352-4393-94fe-36aeeca436b1 tempest-AttachVolumeShelveTestJSON-1940926654 None] Lock "cinder-quobyte-0d95783f-715a-4ef5-aaef-2dcff09b7418" released by "delete_volume" :: held 3.097s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:09:53 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-f2a550fb-b352-4393-94fe-36aeeca436b1 tempest-AttachVolumeShelveTestJSON-1940926654 None] Created reservations ['5840639d-3bdd-469e-a53b-a33dfeb79a5f', 'f3ae2aa8-78ba-4e8a-b665-52062783715e', '4b52aaf7-326e-41be-abe7-4d2bc4d03d84', '0659182d-e950-42a1-8b15-461849c32fb8'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:09:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f2a550fb-b352-4393-94fe-36aeeca436b1 tempest-AttachVolumeShelveTestJSON-1940926654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:09:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f2a550fb-b352-4393-94fe-36aeeca436b1 tempest-AttachVolumeShelveTestJSON-1940926654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:09:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f2a550fb-b352-4393-94fe-36aeeca436b1 tempest-AttachVolumeShelveTestJSON-1940926654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:09:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f2a550fb-b352-4393-94fe-36aeeca436b1 tempest-AttachVolumeShelveTestJSON-1940926654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:09:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f2a550fb-b352-4393-94fe-36aeeca436b1 tempest-AttachVolumeShelveTestJSON-1940926654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:09:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f2a550fb-b352-4393-94fe-36aeeca436b1 tempest-AttachVolumeShelveTestJSON-1940926654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:53 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:09:53 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:54 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-22c1dbb6-d42f-49f6-94f1-b9acebd35cdc tempest-SnapshotsActionsTest-500803998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.181f203e-af06-4b52-8a40-77af188afc2d 1G" returned: 0 in 2.351s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-22c1dbb6-d42f-49f6-94f1-b9acebd35cdc tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.181f203e-af06-4b52-8a40-77af188afc2d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:54 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.181f203e-af06-4b52-8a40-77af188afc2d Jun 30 16:09:54 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:54 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f2a550fb-b352-4393-94fe-36aeeca436b1 tempest-AttachVolumeShelveTestJSON-1940926654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.043s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:54 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-f2a550fb-b352-4393-94fe-36aeeca436b1 tempest-AttachVolumeShelveTestJSON-1940926654 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:09:54 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-f2a550fb-b352-4393-94fe-36aeeca436b1 tempest-AttachVolumeShelveTestJSON-1940926654 None] Deleted volume successfully. Jun 30 16:09:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f2a550fb-b352-4393-94fe-36aeeca436b1 tempest-AttachVolumeShelveTestJSON-1940926654 None] Lock "cinder-0d95783f-715a-4ef5-aaef-2dcff09b7418-delete_volume" released by "delete_volume" :: held 4.724s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:09:55 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-22c1dbb6-d42f-49f6-94f1-b9acebd35cdc tempest-SnapshotsActionsTest-500803998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.181f203e-af06-4b52-8a40-77af188afc2d" returned: 0 in 1.225s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:55 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-22c1dbb6-d42f-49f6-94f1-b9acebd35cdc tempest-SnapshotsActionsTest-500803998 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.181f203e-af06-4b52-8a40-77af188afc2d is being set with open permissions: ugo+rw Jun 30 16:09:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-22c1dbb6-d42f-49f6-94f1-b9acebd35cdc tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.181f203e-af06-4b52-8a40-77af188afc2d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:55 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.181f203e-af06-4b52-8a40-77af188afc2d Jun 30 16:09:55 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:56 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-22c1dbb6-d42f-49f6-94f1-b9acebd35cdc tempest-SnapshotsActionsTest-500803998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.181f203e-af06-4b52-8a40-77af188afc2d" returned: 0 in 1.034s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-22c1dbb6-d42f-49f6-94f1-b9acebd35cdc tempest-SnapshotsActionsTest-500803998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.474s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:09:56 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-22c1dbb6-d42f-49f6-94f1-b9acebd35cdc tempest-SnapshotsActionsTest-500803998 None] Create snapshot completed successfully Jun 30 16:09:58 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8dabed3b-fc21-4e85-8bc1-5ee567cd3362 tempest-SnapshotsActionsTest-814560929 None] Acquiring lock "cinder-181f203e-af06-4b52-8a40-77af188afc2d-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:09:58 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8dabed3b-fc21-4e85-8bc1-5ee567cd3362 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-181f203e-af06-4b52-8a40-77af188afc2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:09:58 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8dabed3b-fc21-4e85-8bc1-5ee567cd3362 tempest-SnapshotsActionsTest-814560929 None] Acquiring lock "cinder-quobyte-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:09:58 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8dabed3b-fc21-4e85-8bc1-5ee567cd3362 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-quobyte-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:09:58 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8dabed3b-fc21-4e85-8bc1-5ee567cd3362 tempest-SnapshotsActionsTest-814560929 None] Acquiring lock "cinder-quobyte-181f203e-af06-4b52-8a40-77af188afc2d" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:09:58 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8dabed3b-fc21-4e85-8bc1-5ee567cd3362 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-quobyte-181f203e-af06-4b52-8a40-77af188afc2d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:09:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-8dabed3b-fc21-4e85-8bc1-5ee567cd3362 tempest-SnapshotsActionsTest-814560929 None] Deleting offline snapshot 181f203e-af06-4b52-8a40-77af188afc2d of volume 0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:09:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-8dabed3b-fc21-4e85-8bc1-5ee567cd3362 tempest-SnapshotsActionsTest-814560929 None] snapshot_file for this snap is: volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.181f203e-af06-4b52-8a40-77af188afc2d {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:09:58 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf6cfb4-2f26-42ef-9461-5dcd2b49d881]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:09:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8dabed3b-fc21-4e85-8bc1-5ee567cd3362 tempest-SnapshotsActionsTest-814560929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.181f203e-af06-4b52-8a40-77af188afc2d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:58 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.181f203e-af06-4b52-8a40-77af188afc2d Jun 30 16:09:58 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:09:59 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Jun 30 16:09:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8dabed3b-fc21-4e85-8bc1-5ee567cd3362 tempest-SnapshotsActionsTest-814560929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.181f203e-af06-4b52-8a40-77af188afc2d" returned: 0 in 1.252s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:09:59 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-8dabed3b-fc21-4e85-8bc1-5ee567cd3362 tempest-SnapshotsActionsTest-814560929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:09:59 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58f42ad-39f0-40fd-8822-e5ed5d21fca6]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:09:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8dabed3b-fc21-4e85-8bc1-5ee567cd3362 tempest-SnapshotsActionsTest-814560929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:09:59 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 Jun 30 16:09:59 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:01 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8dabed3b-fc21-4e85-8bc1-5ee567cd3362 tempest-SnapshotsActionsTest-814560929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917" returned: 0 in 1.383s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:01 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-8dabed3b-fc21-4e85-8bc1-5ee567cd3362 tempest-SnapshotsActionsTest-814560929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:10:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8dabed3b-fc21-4e85-8bc1-5ee567cd3362 tempest-SnapshotsActionsTest-814560929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.181f203e-af06-4b52-8a40-77af188afc2d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:01 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.181f203e-af06-4b52-8a40-77af188afc2d Jun 30 16:10:01 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:02 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8dabed3b-fc21-4e85-8bc1-5ee567cd3362 tempest-SnapshotsActionsTest-814560929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.181f203e-af06-4b52-8a40-77af188afc2d" returned: 0 in 1.154s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8dabed3b-fc21-4e85-8bc1-5ee567cd3362 tempest-SnapshotsActionsTest-814560929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.181f203e-af06-4b52-8a40-77af188afc2d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:02 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.181f203e-af06-4b52-8a40-77af188afc2d Jun 30 16:10:02 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:03 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8dabed3b-fc21-4e85-8bc1-5ee567cd3362 tempest-SnapshotsActionsTest-814560929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.181f203e-af06-4b52-8a40-77af188afc2d" returned: 0 in 0.916s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:03 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8dabed3b-fc21-4e85-8bc1-5ee567cd3362 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-quobyte-181f203e-af06-4b52-8a40-77af188afc2d" released by "_delete_snapshot" :: held 4.911s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:10:03 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8dabed3b-fc21-4e85-8bc1-5ee567cd3362 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-quobyte-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589" released by "delete_snapshot" :: held 4.943s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:10:03 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:UPDATE=51,cinder:SELECT=50,cinder:INSERT=11,cinder:DELETE=3 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:10:03 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:UPDATE=54,cinder:SELECT=40,cinder:INSERT=13,cinder:DELETE=3 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:10:03 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-8dabed3b-fc21-4e85-8bc1-5ee567cd3362 tempest-SnapshotsActionsTest-814560929 None] Created reservations ['4cab3664-5569-4cd4-a374-fb98de172bab', 'b355e980-69b4-4c17-8c6e-898c3bf703f4', '2428d78c-84e6-4aa4-98af-b07b29a61624', '9671ba06-cc6e-4282-92ab-eb36525393b5'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:10:03 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-8dabed3b-fc21-4e85-8bc1-5ee567cd3362 tempest-SnapshotsActionsTest-814560929 None] Delete snapshot completed successfully. Jun 30 16:10:03 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8dabed3b-fc21-4e85-8bc1-5ee567cd3362 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-181f203e-af06-4b52-8a40-77af188afc2d-delete_snapshot" released by "delete_snapshot" :: held 5.444s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:10:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-edf952e7-726d-424c-91a4-e4bfd270e3ea tempest-SnapshotsActionsTest-500803998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:10:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-edf952e7-726d-424c-91a4-e4bfd270e3ea tempest-SnapshotsActionsTest-500803998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:10:04 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-edf952e7-726d-424c-91a4-e4bfd270e3ea tempest-SnapshotsActionsTest-500803998 None] Creating offline snapshot b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b of volume 0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:10:04 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[3066f316-10c9-43ed-81bf-3050b6941c90]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:10:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edf952e7-726d-424c-91a4-e4bfd270e3ea tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:04 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 Jun 30 16:10:04 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:05 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edf952e7-726d-424c-91a4-e4bfd270e3ea tempest-SnapshotsActionsTest-500803998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917" returned: 0 in 1.211s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:05 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-edf952e7-726d-424c-91a4-e4bfd270e3ea tempest-SnapshotsActionsTest-500803998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:10:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edf952e7-726d-424c-91a4-e4bfd270e3ea tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:05 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b 1G Jun 30 16:10:05 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:06 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edf952e7-726d-424c-91a4-e4bfd270e3ea tempest-SnapshotsActionsTest-500803998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b 1G" returned: 0 in 1.230s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edf952e7-726d-424c-91a4-e4bfd270e3ea tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:06 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b Jun 30 16:10:06 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:07 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edf952e7-726d-424c-91a4-e4bfd270e3ea tempest-SnapshotsActionsTest-500803998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b" returned: 0 in 1.004s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:07 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-edf952e7-726d-424c-91a4-e4bfd270e3ea tempest-SnapshotsActionsTest-500803998 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b is being set with open permissions: ugo+rw Jun 30 16:10:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edf952e7-726d-424c-91a4-e4bfd270e3ea tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:07 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b Jun 30 16:10:07 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:08 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-da30a0a7-535f-4034-91df-37a58819add5 tempest-GroupSnapshotsV319Test-645442940 None] Group tempest-GroupSnapshotsV319Test-Group-201411184: creating Jun 30 16:10:08 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-da30a0a7-535f-4034-91df-37a58819add5 tempest-GroupSnapshotsV319Test-645442940 None] Group tempest-GroupSnapshotsV319Test-Group-201411184: created successfully Jun 30 16:10:08 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-da30a0a7-535f-4034-91df-37a58819add5 tempest-GroupSnapshotsV319Test-645442940 None] Create group completed successfully. Jun 30 16:10:08 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edf952e7-726d-424c-91a4-e4bfd270e3ea tempest-SnapshotsActionsTest-500803998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b" returned: 0 in 0.723s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-edf952e7-726d-424c-91a4-e4bfd270e3ea tempest-SnapshotsActionsTest-500803998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.335s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:10:08 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-edf952e7-726d-424c-91a4-e4bfd270e3ea tempest-SnapshotsActionsTest-500803998 None] Create snapshot completed successfully Jun 30 16:10:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-86d14385-6776-4b83-a76f-e03f47a493e0 tempest-SnapshotsActionsTest-814560929 None] Acquiring lock "cinder-b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:10:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-86d14385-6776-4b83-a76f-e03f47a493e0 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:10:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-86d14385-6776-4b83-a76f-e03f47a493e0 tempest-SnapshotsActionsTest-814560929 None] Acquiring lock "cinder-quobyte-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:10:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-86d14385-6776-4b83-a76f-e03f47a493e0 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-quobyte-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:10:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-86d14385-6776-4b83-a76f-e03f47a493e0 tempest-SnapshotsActionsTest-814560929 None] Acquiring lock "cinder-quobyte-b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:10:09 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:10:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Flow 'volume_create_manager' (fe350cfc-f8b3-47a0-afa3-46c8eef11670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:10:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e6db2e-bf40-4093-bfb1-86f6dba8b56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-86d14385-6776-4b83-a76f-e03f47a493e0 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-quobyte-b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:10:09 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-86d14385-6776-4b83-a76f-e03f47a493e0 tempest-SnapshotsActionsTest-814560929 None] Deleting offline snapshot b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b of volume 0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:10:09 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-86d14385-6776-4b83-a76f-e03f47a493e0 tempest-SnapshotsActionsTest-814560929 None] snapshot_file for this snap is: volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:10:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e6db2e-bf40-4093-bfb1-86f6dba8b56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1197653597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=01311900-e977-4116-82ec-c647995b5c75,host='devstack@QuobyteHD#QuobyteHD',id=9bd71f73-765a-4f6f-b51d-02ec8d65d746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c3f036ece94583a212549e231f098f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:10:10Z,use_quota=True,user_id='f7c31e397f3d43f4a3d237a68311590a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21d3da79-c00c-4f75-806c-b32412cd8338),volume_type_id=21d3da79-c00c-4f75-806c-b32412cd8338)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe49d5f-56af-446d-a623-3665ee01e4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fe49d5f-56af-446d-a623-3665ee01e4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaadc09c-1eb6-4526-9115-046b172b44c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaadc09c-1eb6-4526-9115-046b172b44c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bd71f73-765a-4f6f-b51d-02ec8d65d746', 'volume_name': 'volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb952958-1f83-4bf2-b438-bdee0309c009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb952958-1f83-4bf2-b438-bdee0309c009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc2b892-aa04-44f6-bf86-f9fc02fd7fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:10 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Volume 9bd71f73-765a-4f6f-b51d-02ec8d65d746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746', 'volume_size': 1} Jun 30 16:10:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:10:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:10:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=01311900-e977-4116-82ec-c647995b5c75,created_at=2026-06-30T14:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1197653597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=01311900-e977-4116-82ec-c647995b5c75,host='devstack@QuobyteHD#QuobyteHD',id=9bd71f73-765a-4f6f-b51d-02ec8d65d746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c3f036ece94583a212549e231f098f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:10:10Z,use_quota=True,user_id='f7c31e397f3d43f4a3d237a68311590a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21d3da79-c00c-4f75-806c-b32412cd8338),volume_type_id=21d3da79-c00c-4f75-806c-b32412cd8338)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:10:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Creating volume 9bd71f73-765a-4f6f-b51d-02ec8d65d746 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:10:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:10:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:10:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:10:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:10:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:10:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:10:10 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:10:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:10 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f84cc44-148a-4c58-983f-fe187447be21]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:10:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86d14385-6776-4b83-a76f-e03f47a493e0 tempest-SnapshotsActionsTest-814560929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:10 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746 1073741824 Jun 30 16:10:10 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:10 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b Jun 30 16:10:10 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:11 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86d14385-6776-4b83-a76f-e03f47a493e0 tempest-SnapshotsActionsTest-814560929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b" returned: 0 in 1.145s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:11 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-86d14385-6776-4b83-a76f-e03f47a493e0 tempest-SnapshotsActionsTest-814560929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:10:11 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b1bec5-ff00-4879-a8c5-32f7a2e08f62]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:10:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86d14385-6776-4b83-a76f-e03f47a493e0 tempest-SnapshotsActionsTest-814560929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:11 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746 1073741824" returned: 0 in 1.224s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:11 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746 Jun 30 16:10:11 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:11 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 Jun 30 16:10:11 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:11 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746" returned: 0 in 0.677s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:11 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:10:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:10:11 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc2b892-aa04-44f6-bf86-f9fc02fd7fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:12 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be7f853-55da-4608-b2b6-9135589167c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:12 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Volume volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746 (9bd71f73-765a-4f6f-b51d-02ec8d65d746): created successfully Jun 30 16:10:12 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:12 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be7f853-55da-4608-b2b6-9135589167c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:12 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Flow 'volume_create_manager' (fe350cfc-f8b3-47a0-afa3-46c8eef11670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:10:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86d14385-6776-4b83-a76f-e03f47a493e0 tempest-SnapshotsActionsTest-814560929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917" returned: 0 in 0.839s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:12 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-86d14385-6776-4b83-a76f-e03f47a493e0 tempest-SnapshotsActionsTest-814560929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:10:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86d14385-6776-4b83-a76f-e03f47a493e0 tempest-SnapshotsActionsTest-814560929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:12 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-1b0dd1e0-1d0a-42ce-80df-9eb47da6103e tempest-GroupSnapshotsV319Test-645442940 None] Created volume successfully. Jun 30 16:10:12 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b Jun 30 16:10:12 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:12 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-3ed57f27-0cf4-4a23-b9e3-25c8f435443e tempest-GroupSnapshotsV319Test-645442940 None] GroupSnapshot 3bb759b0-b44d-4846-9e49-90fe6d6c9342: creating. Jun 30 16:10:12 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3ed57f27-0cf4-4a23-b9e3-25c8f435443e tempest-GroupSnapshotsV319Test-645442940 None] Group snapshot 3bb759b0-b44d-4846-9e49-90fe6d6c9342: creating. {{(pid=93781) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 30 16:10:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3ed57f27-0cf4-4a23-b9e3-25c8f435443e tempest-GroupSnapshotsV319Test-645442940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:10:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3ed57f27-0cf4-4a23-b9e3-25c8f435443e tempest-GroupSnapshotsV319Test-645442940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:10:12 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-3ed57f27-0cf4-4a23-b9e3-25c8f435443e tempest-GroupSnapshotsV319Test-645442940 None] Creating offline snapshot 8939ac76-4291-4d7b-a544-3539d1fe584f of volume 9bd71f73-765a-4f6f-b51d-02ec8d65d746 {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:10:12 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c7b945-9a66-4d46-bf1f-337e9c5f1975]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:10:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3ed57f27-0cf4-4a23-b9e3-25c8f435443e tempest-GroupSnapshotsV319Test-645442940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:12 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746 Jun 30 16:10:12 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:13 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86d14385-6776-4b83-a76f-e03f47a493e0 tempest-SnapshotsActionsTest-814560929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b" returned: 0 in 1.008s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86d14385-6776-4b83-a76f-e03f47a493e0 tempest-SnapshotsActionsTest-814560929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:13 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b Jun 30 16:10:13 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:14 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3ed57f27-0cf4-4a23-b9e3-25c8f435443e tempest-GroupSnapshotsV319Test-645442940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746" returned: 0 in 1.550s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3ed57f27-0cf4-4a23-b9e3-25c8f435443e tempest-GroupSnapshotsV319Test-645442940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.8939ac76-4291-4d7b-a544-3539d1fe584f 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:14 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.8939ac76-4291-4d7b-a544-3539d1fe584f 1G Jun 30 16:10:14 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:14 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86d14385-6776-4b83-a76f-e03f47a493e0 tempest-SnapshotsActionsTest-814560929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b" returned: 0 in 1.442s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:14 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-86d14385-6776-4b83-a76f-e03f47a493e0 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-quobyte-b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b" released by "_delete_snapshot" :: held 4.640s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:10:14 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-86d14385-6776-4b83-a76f-e03f47a493e0 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-quobyte-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589" released by "delete_snapshot" :: held 4.707s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:10:14 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-86d14385-6776-4b83-a76f-e03f47a493e0 tempest-SnapshotsActionsTest-814560929 None] Created reservations ['30866e2a-b0f9-423c-b9fb-8d2bce34ff81', '65cc054f-99b0-473c-a64c-99ca9428299f', 'd5d90f21-141b-412b-9a57-c6ef4f97909a', '766b9801-259f-46d8-b5a1-8a95199cf9af'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:10:14 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-86d14385-6776-4b83-a76f-e03f47a493e0 tempest-SnapshotsActionsTest-814560929 None] Delete snapshot completed successfully. Jun 30 16:10:14 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-86d14385-6776-4b83-a76f-e03f47a493e0 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-b234d0c4-ad9d-4f68-9d64-edc15ea1cc4b-delete_snapshot" released by "delete_snapshot" :: held 5.003s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:10:15 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3ed57f27-0cf4-4a23-b9e3-25c8f435443e tempest-GroupSnapshotsV319Test-645442940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.8939ac76-4291-4d7b-a544-3539d1fe584f 1G" returned: 0 in 1.419s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3ed57f27-0cf4-4a23-b9e3-25c8f435443e tempest-GroupSnapshotsV319Test-645442940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.8939ac76-4291-4d7b-a544-3539d1fe584f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:15 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.8939ac76-4291-4d7b-a544-3539d1fe584f Jun 30 16:10:15 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-de67fd35-a2ac-41be-a3d1-121b2b459be8 tempest-SnapshotsActionsTest-500803998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:10:16 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3ed57f27-0cf4-4a23-b9e3-25c8f435443e tempest-GroupSnapshotsV319Test-645442940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.8939ac76-4291-4d7b-a544-3539d1fe584f" returned: 0 in 0.918s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:16 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-3ed57f27-0cf4-4a23-b9e3-25c8f435443e tempest-GroupSnapshotsV319Test-645442940 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.8939ac76-4291-4d7b-a544-3539d1fe584f is being set with open permissions: ugo+rw: NotImplementedError Jun 30 16:10:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3ed57f27-0cf4-4a23-b9e3-25c8f435443e tempest-GroupSnapshotsV319Test-645442940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.8939ac76-4291-4d7b-a544-3539d1fe584f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:16 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.8939ac76-4291-4d7b-a544-3539d1fe584f Jun 30 16:10:16 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:18 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:18 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:10:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Flow 'volume_create_manager' (9005b649-a000-4396-902d-b70140ab303a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:10:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5380306-142d-45b7-a1ec-9c1f72e17b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3ed57f27-0cf4-4a23-b9e3-25c8f435443e tempest-GroupSnapshotsV319Test-645442940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.8939ac76-4291-4d7b-a544-3539d1fe584f" returned: 0 in 1.430s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5380306-142d-45b7-a1ec-9c1f72e17b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1184234585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825deee8-8c26-439a-8466-1a41a8035c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be84181e4b8d4fc1b3bbd362973a4294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:10:18Z,use_quota=True,user_id='d1d1ff2af51d46b69f312280d062f3db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8fa0a41-bb37-40bb-b37d-08d53deaa134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8fa0a41-bb37-40bb-b37d-08d53deaa134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73689b0d-6816-4c56-a422-ff88b4aa7419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73689b0d-6816-4c56-a422-ff88b4aa7419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '825deee8-8c26-439a-8466-1a41a8035c99', 'volume_name': 'volume-825deee8-8c26-439a-8466-1a41a8035c99', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (841689b8-d97d-4d48-9071-5bc75b01efb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (841689b8-d97d-4d48-9071-5bc75b01efb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1fe5bd2-0fc5-4395-a6da-e483f4986346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:18 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Volume 825deee8-8c26-439a-8466-1a41a8035c99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-825deee8-8c26-439a-8466-1a41a8035c99', 'volume_size': 1} Jun 30 16:10:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:10:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3ed57f27-0cf4-4a23-b9e3-25c8f435443e tempest-GroupSnapshotsV319Test-645442940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:18 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.info Jun 30 16:10:18 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:18 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3ed57f27-0cf4-4a23-b9e3-25c8f435443e tempest-GroupSnapshotsV319Test-645442940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.info" returned: 0 in 0.793s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:18 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-3ed57f27-0cf4-4a23-b9e3-25c8f435443e tempest-GroupSnapshotsV319Test-645442940 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.info is being set with open permissions: ugo+rw: NotImplementedError Jun 30 16:10:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3ed57f27-0cf4-4a23-b9e3-25c8f435443e tempest-GroupSnapshotsV319Test-645442940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:19 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.info Jun 30 16:10:19 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:19 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3ed57f27-0cf4-4a23-b9e3-25c8f435443e tempest-GroupSnapshotsV319Test-645442940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.info" returned: 0 in 0.752s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3ed57f27-0cf4-4a23-b9e3-25c8f435443e tempest-GroupSnapshotsV319Test-645442940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.056s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:10:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-de67fd35-a2ac-41be-a3d1-121b2b459be8 tempest-SnapshotsActionsTest-500803998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.998s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:10:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-de67fd35-a2ac-41be-a3d1-121b2b459be8 tempest-SnapshotsActionsTest-500803998 None] Creating offline snapshot aeff7831-9061-4b52-a771-3013b7678d7e of volume 0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:10:19 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[0816325b-a114-44f3-b08d-baf87e16edf1]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:10:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-de67fd35-a2ac-41be-a3d1-121b2b459be8 tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:19 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-3ed57f27-0cf4-4a23-b9e3-25c8f435443e tempest-GroupSnapshotsV319Test-645442940 None] group_snapshot 3bb759b0-b44d-4846-9e49-90fe6d6c9342: created successfully Jun 30 16:10:20 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 Jun 30 16:10:20 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:20 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-549ae5cf-fffd-4b5f-8676-2fdc0446f2b5 tempest-GroupSnapshotsV319Test-645442940 None] group_snapshot 3bb759b0-b44d-4846-9e49-90fe6d6c9342: deleting Jun 30 16:10:20 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-549ae5cf-fffd-4b5f-8676-2fdc0446f2b5 tempest-GroupSnapshotsV319Test-645442940 None] group_snapshot 3bb759b0-b44d-4846-9e49-90fe6d6c9342: deleting {{(pid=93781) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 30 16:10:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-549ae5cf-fffd-4b5f-8676-2fdc0446f2b5 tempest-GroupSnapshotsV319Test-645442940 None] Acquiring lock "cinder-quobyte-9bd71f73-765a-4f6f-b51d-02ec8d65d746" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:10:20 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-de67fd35-a2ac-41be-a3d1-121b2b459be8 tempest-SnapshotsActionsTest-500803998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917" returned: 0 in 0.922s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:20 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-de67fd35-a2ac-41be-a3d1-121b2b459be8 tempest-SnapshotsActionsTest-500803998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:10:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-de67fd35-a2ac-41be-a3d1-121b2b459be8 tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.aeff7831-9061-4b52-a771-3013b7678d7e 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-549ae5cf-fffd-4b5f-8676-2fdc0446f2b5 tempest-GroupSnapshotsV319Test-645442940 None] Lock "cinder-quobyte-9bd71f73-765a-4f6f-b51d-02ec8d65d746" acquired by "delete_snapshot" :: waited 0.053s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:10:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-549ae5cf-fffd-4b5f-8676-2fdc0446f2b5 tempest-GroupSnapshotsV319Test-645442940 None] Acquiring lock "cinder-quobyte-8939ac76-4291-4d7b-a544-3539d1fe584f" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:10:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-549ae5cf-fffd-4b5f-8676-2fdc0446f2b5 tempest-GroupSnapshotsV319Test-645442940 None] Lock "cinder-quobyte-8939ac76-4291-4d7b-a544-3539d1fe584f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:10:20 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-549ae5cf-fffd-4b5f-8676-2fdc0446f2b5 tempest-GroupSnapshotsV319Test-645442940 None] Deleting offline snapshot 8939ac76-4291-4d7b-a544-3539d1fe584f of volume 9bd71f73-765a-4f6f-b51d-02ec8d65d746 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:10:20 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.aeff7831-9061-4b52-a771-3013b7678d7e 1G Jun 30 16:10:20 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:20 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-549ae5cf-fffd-4b5f-8676-2fdc0446f2b5 tempest-GroupSnapshotsV319Test-645442940 None] snapshot_file for this snap is: volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.8939ac76-4291-4d7b-a544-3539d1fe584f {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:10:20 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b03893-659e-44e8-8f88-073dc136129e]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:10:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-549ae5cf-fffd-4b5f-8676-2fdc0446f2b5 tempest-GroupSnapshotsV319Test-645442940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.8939ac76-4291-4d7b-a544-3539d1fe584f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:21 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.8939ac76-4291-4d7b-a544-3539d1fe584f Jun 30 16:10:21 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:22 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-549ae5cf-fffd-4b5f-8676-2fdc0446f2b5 tempest-GroupSnapshotsV319Test-645442940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.8939ac76-4291-4d7b-a544-3539d1fe584f" returned: 0 in 1.478s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:22 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-549ae5cf-fffd-4b5f-8676-2fdc0446f2b5 tempest-GroupSnapshotsV319Test-645442940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:10:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-de67fd35-a2ac-41be-a3d1-121b2b459be8 tempest-SnapshotsActionsTest-500803998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.aeff7831-9061-4b52-a771-3013b7678d7e 1G" returned: 0 in 1.658s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-de67fd35-a2ac-41be-a3d1-121b2b459be8 tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.aeff7831-9061-4b52-a771-3013b7678d7e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:22 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:22 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[699db826-42ba-4bef-8aeb-c2d508698bc9]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:10:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-549ae5cf-fffd-4b5f-8676-2fdc0446f2b5 tempest-GroupSnapshotsV319Test-645442940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:22 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.aeff7831-9061-4b52-a771-3013b7678d7e Jun 30 16:10:22 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:22 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746 Jun 30 16:10:22 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:23 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-de67fd35-a2ac-41be-a3d1-121b2b459be8 tempest-SnapshotsActionsTest-500803998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.aeff7831-9061-4b52-a771-3013b7678d7e" returned: 0 in 0.792s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:23 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-de67fd35-a2ac-41be-a3d1-121b2b459be8 tempest-SnapshotsActionsTest-500803998 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.aeff7831-9061-4b52-a771-3013b7678d7e is being set with open permissions: ugo+rw Jun 30 16:10:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-de67fd35-a2ac-41be-a3d1-121b2b459be8 tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.aeff7831-9061-4b52-a771-3013b7678d7e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:23 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.aeff7831-9061-4b52-a771-3013b7678d7e Jun 30 16:10:23 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:23 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-549ae5cf-fffd-4b5f-8676-2fdc0446f2b5 tempest-GroupSnapshotsV319Test-645442940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746" returned: 0 in 0.878s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-549ae5cf-fffd-4b5f-8676-2fdc0446f2b5 tempest-GroupSnapshotsV319Test-645442940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.8939ac76-4291-4d7b-a544-3539d1fe584f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:23 devstack sudo[99791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.8939ac76-4291-4d7b-a544-3539d1fe584f Jun 30 16:10:23 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:24 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-de67fd35-a2ac-41be-a3d1-121b2b459be8 tempest-SnapshotsActionsTest-500803998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.aeff7831-9061-4b52-a771-3013b7678d7e" returned: 0 in 0.777s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-de67fd35-a2ac-41be-a3d1-121b2b459be8 tempest-SnapshotsActionsTest-500803998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.287s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:10:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.900s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:10:24 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1184234585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=825deee8-8c26-439a-8466-1a41a8035c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be84181e4b8d4fc1b3bbd362973a4294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:10:18Z,use_quota=True,user_id='d1d1ff2af51d46b69f312280d062f3db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:10:24 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Creating volume 825deee8-8c26-439a-8466-1a41a8035c99 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:10:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:10:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:10:24 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:10:24 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:10:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:10:24 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:10:24 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:10:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-825deee8-8c26-439a-8466-1a41a8035c99 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:24 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-825deee8-8c26-439a-8466-1a41a8035c99 1073741824 Jun 30 16:10:24 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:24 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-de67fd35-a2ac-41be-a3d1-121b2b459be8 tempest-SnapshotsActionsTest-500803998 None] Create snapshot completed successfully Jun 30 16:10:24 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-549ae5cf-fffd-4b5f-8676-2fdc0446f2b5 tempest-GroupSnapshotsV319Test-645442940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.8939ac76-4291-4d7b-a544-3539d1fe584f" returned: 0 in 0.898s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-549ae5cf-fffd-4b5f-8676-2fdc0446f2b5 tempest-GroupSnapshotsV319Test-645442940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.8939ac76-4291-4d7b-a544-3539d1fe584f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:24 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.8939ac76-4291-4d7b-a544-3539d1fe584f Jun 30 16:10:24 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:24 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-549ae5cf-fffd-4b5f-8676-2fdc0446f2b5 tempest-GroupSnapshotsV319Test-645442940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746.8939ac76-4291-4d7b-a544-3539d1fe584f" returned: 0 in 0.720s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-549ae5cf-fffd-4b5f-8676-2fdc0446f2b5 tempest-GroupSnapshotsV319Test-645442940 None] Lock "cinder-quobyte-8939ac76-4291-4d7b-a544-3539d1fe584f" released by "_delete_snapshot" :: held 4.160s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:10:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-549ae5cf-fffd-4b5f-8676-2fdc0446f2b5 tempest-GroupSnapshotsV319Test-645442940 None] Lock "cinder-quobyte-9bd71f73-765a-4f6f-b51d-02ec8d65d746" released by "delete_snapshot" :: held 4.197s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:10:25 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-825deee8-8c26-439a-8466-1a41a8035c99 1073741824" returned: 0 in 0.987s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-825deee8-8c26-439a-8466-1a41a8035c99 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:25 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-825deee8-8c26-439a-8466-1a41a8035c99 Jun 30 16:10:25 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:25 devstack cinder-volume[93781]: WARNING cinder.quota [None req-549ae5cf-fffd-4b5f-8676-2fdc0446f2b5 tempest-GroupSnapshotsV319Test-645442940 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-989474539 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-989474539, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:10:25 devstack cinder-volume[93781]: WARNING cinder.quota [None req-549ae5cf-fffd-4b5f-8676-2fdc0446f2b5 tempest-GroupSnapshotsV319Test-645442940 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-989474539 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-989474539, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:10:25 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-549ae5cf-fffd-4b5f-8676-2fdc0446f2b5 tempest-GroupSnapshotsV319Test-645442940 None] Created reservations ['496c1d4b-2ee1-4bea-90e7-56cd1729561a', '3f690b2d-8f46-42aa-ac96-2ac7efadcd31', '1f85f97a-aa55-4aa4-a1d9-54e4f36eb80f', '13f97953-0815-4b2c-bcd4-03db65ad6a1a'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:10:25 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-549ae5cf-fffd-4b5f-8676-2fdc0446f2b5 tempest-GroupSnapshotsV319Test-645442940 None] group_snapshot 3bb759b0-b44d-4846-9e49-90fe6d6c9342: deleted successfully Jun 30 16:10:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-569239b3-ecbd-408c-8155-54463b436540 tempest-SnapshotsActionsTest-814560929 None] Acquiring lock "cinder-aeff7831-9061-4b52-a771-3013b7678d7e-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:10:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-569239b3-ecbd-408c-8155-54463b436540 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-aeff7831-9061-4b52-a771-3013b7678d7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:10:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-569239b3-ecbd-408c-8155-54463b436540 tempest-SnapshotsActionsTest-814560929 None] Acquiring lock "cinder-quobyte-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:10:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-569239b3-ecbd-408c-8155-54463b436540 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-quobyte-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:10:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-569239b3-ecbd-408c-8155-54463b436540 tempest-SnapshotsActionsTest-814560929 None] Acquiring lock "cinder-quobyte-aeff7831-9061-4b52-a771-3013b7678d7e" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:10:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-569239b3-ecbd-408c-8155-54463b436540 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-quobyte-aeff7831-9061-4b52-a771-3013b7678d7e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:10:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-569239b3-ecbd-408c-8155-54463b436540 tempest-SnapshotsActionsTest-814560929 None] Deleting offline snapshot aeff7831-9061-4b52-a771-3013b7678d7e of volume 0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:10:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-569239b3-ecbd-408c-8155-54463b436540 tempest-SnapshotsActionsTest-814560929 None] snapshot_file for this snap is: volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.aeff7831-9061-4b52-a771-3013b7678d7e {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:10:25 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac35b65-2938-4695-a6fd-538cb132d5cd]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:10:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-569239b3-ecbd-408c-8155-54463b436540 tempest-SnapshotsActionsTest-814560929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.aeff7831-9061-4b52-a771-3013b7678d7e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:25 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.aeff7831-9061-4b52-a771-3013b7678d7e Jun 30 16:10:25 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2bc3bf36-1181-436c-a8f5-9dad54c75164 tempest-GroupSnapshotsV319Test-645442940 None] Acquiring lock "cinder-quobyte-9bd71f73-765a-4f6f-b51d-02ec8d65d746" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:10:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2bc3bf36-1181-436c-a8f5-9dad54c75164 tempest-GroupSnapshotsV319Test-645442940 None] Lock "cinder-quobyte-9bd71f73-765a-4f6f-b51d-02ec8d65d746" acquired by "delete_volume" :: waited 0.021s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:10:25 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af88e26-b05c-4f77-ae38-77504ec7c59f]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:10:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2bc3bf36-1181-436c-a8f5-9dad54c75164 tempest-GroupSnapshotsV319Test-645442940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:26 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-825deee8-8c26-439a-8466-1a41a8035c99" returned: 0 in 0.981s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:26 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] <== create_volume: return (2059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:10:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:10:26 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746 Jun 30 16:10:26 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:26 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1fe5bd2-0fc5-4395-a6da-e483f4986346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-825deee8-8c26-439a-8466-1a41a8035c99', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:26 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b26af6-b73f-474a-88cb-02cef789a68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:26 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Volume volume-825deee8-8c26-439a-8466-1a41a8035c99 (825deee8-8c26-439a-8466-1a41a8035c99): created successfully Jun 30 16:10:26 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b26af6-b73f-474a-88cb-02cef789a68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:26 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Flow 'volume_create_manager' (9005b649-a000-4396-902d-b70140ab303a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:10:26 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-0cf65a96-1005-4430-819b-99ef23b5f89b tempest-AttachVolumeTestJSON-1554772577 None] Created volume successfully. Jun 30 16:10:26 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-569239b3-ecbd-408c-8155-54463b436540 tempest-SnapshotsActionsTest-814560929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.aeff7831-9061-4b52-a771-3013b7678d7e" returned: 0 in 1.172s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:26 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-569239b3-ecbd-408c-8155-54463b436540 tempest-SnapshotsActionsTest-814560929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:10:26 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9f4061-34ed-4880-941a-9623caa9ff17]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:10:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-569239b3-ecbd-408c-8155-54463b436540 tempest-SnapshotsActionsTest-814560929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:26 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 Jun 30 16:10:26 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:26 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2bc3bf36-1181-436c-a8f5-9dad54c75164 tempest-GroupSnapshotsV319Test-645442940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746" returned: 0 in 0.949s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2bc3bf36-1181-436c-a8f5-9dad54c75164 tempest-GroupSnapshotsV319Test-645442940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:26 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746 Jun 30 16:10:26 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:27 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-569239b3-ecbd-408c-8155-54463b436540 tempest-SnapshotsActionsTest-814560929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917" returned: 0 in 0.921s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:27 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-569239b3-ecbd-408c-8155-54463b436540 tempest-SnapshotsActionsTest-814560929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:10:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-569239b3-ecbd-408c-8155-54463b436540 tempest-SnapshotsActionsTest-814560929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.aeff7831-9061-4b52-a771-3013b7678d7e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:27 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.aeff7831-9061-4b52-a771-3013b7678d7e Jun 30 16:10:27 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:28 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2bc3bf36-1181-436c-a8f5-9dad54c75164 tempest-GroupSnapshotsV319Test-645442940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9bd71f73-765a-4f6f-b51d-02ec8d65d746" returned: 0 in 1.164s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:28 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2bc3bf36-1181-436c-a8f5-9dad54c75164 tempest-GroupSnapshotsV319Test-645442940 None] Lock "cinder-quobyte-9bd71f73-765a-4f6f-b51d-02ec8d65d746" released by "delete_volume" :: held 2.211s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:10:28 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-2bc3bf36-1181-436c-a8f5-9dad54c75164 tempest-GroupSnapshotsV319Test-645442940 None] Created reservations ['602d5c58-a337-4528-b1bd-91a692590d3d'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:10:28 devstack cinder-volume[93781]: WARNING cinder.quota [None req-2bc3bf36-1181-436c-a8f5-9dad54c75164 tempest-GroupSnapshotsV319Test-645442940 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-989474539 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-989474539, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:10:28 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-2bc3bf36-1181-436c-a8f5-9dad54c75164 tempest-GroupSnapshotsV319Test-645442940 None] Created reservations ['37ee768a-fada-48c5-bfff-470f2bcc7539', '46174673-e4c6-4a80-af36-02785dc9a6bd', '32c33ec7-30b5-4e33-9322-e008460ed046', 'a4d082b1-40ae-42ff-ae6f-537f7d952579'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:10:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2bc3bf36-1181-436c-a8f5-9dad54c75164 tempest-GroupSnapshotsV319Test-645442940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:10:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2bc3bf36-1181-436c-a8f5-9dad54c75164 tempest-GroupSnapshotsV319Test-645442940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:10:28 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-2bc3bf36-1181-436c-a8f5-9dad54c75164 tempest-GroupSnapshotsV319Test-645442940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:10:28 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-2bc3bf36-1181-436c-a8f5-9dad54c75164 tempest-GroupSnapshotsV319Test-645442940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:10:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2bc3bf36-1181-436c-a8f5-9dad54c75164 tempest-GroupSnapshotsV319Test-645442940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:10:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2bc3bf36-1181-436c-a8f5-9dad54c75164 tempest-GroupSnapshotsV319Test-645442940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:28 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:10:28 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:29 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2bc3bf36-1181-436c-a8f5-9dad54c75164 tempest-GroupSnapshotsV319Test-645442940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.997s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:29 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-2bc3bf36-1181-436c-a8f5-9dad54c75164 tempest-GroupSnapshotsV319Test-645442940 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:10:29 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-2bc3bf36-1181-436c-a8f5-9dad54c75164 tempest-GroupSnapshotsV319Test-645442940 None] Delete group completed successfully. Jun 30 16:10:29 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-569239b3-ecbd-408c-8155-54463b436540 tempest-SnapshotsActionsTest-814560929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.aeff7831-9061-4b52-a771-3013b7678d7e" returned: 0 in 2.113s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-569239b3-ecbd-408c-8155-54463b436540 tempest-SnapshotsActionsTest-814560929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.aeff7831-9061-4b52-a771-3013b7678d7e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:29 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.aeff7831-9061-4b52-a771-3013b7678d7e Jun 30 16:10:29 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-f2884661-efc8-4884-8142-8d7399f9315b req-4b3dfcca-0a09-4118-8fc4-9bf110765551 tempest-AttachVolumeTestJSON-1554772577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:10:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-f2884661-efc8-4884-8142-8d7399f9315b req-4b3dfcca-0a09-4118-8fc4-9bf110765551 tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:10:30 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[137219b5-8fe1-43b8-b7ad-e68b8bc4b4c0]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:10:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-f2884661-efc8-4884-8142-8d7399f9315b req-4b3dfcca-0a09-4118-8fc4-9bf110765551 tempest-AttachVolumeTestJSON-1554772577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-825deee8-8c26-439a-8466-1a41a8035c99 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:30 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-825deee8-8c26-439a-8466-1a41a8035c99 Jun 30 16:10:30 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:30 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-569239b3-ecbd-408c-8155-54463b436540 tempest-SnapshotsActionsTest-814560929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.aeff7831-9061-4b52-a771-3013b7678d7e" returned: 0 in 0.985s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:30 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-569239b3-ecbd-408c-8155-54463b436540 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-quobyte-aeff7831-9061-4b52-a771-3013b7678d7e" released by "_delete_snapshot" :: held 5.347s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:10:30 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-569239b3-ecbd-408c-8155-54463b436540 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-quobyte-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589" released by "delete_snapshot" :: held 5.394s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:10:31 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-569239b3-ecbd-408c-8155-54463b436540 tempest-SnapshotsActionsTest-814560929 None] Created reservations ['bf0d185d-2b43-40ad-b985-6544c0af0309', '0794649f-9723-438f-8247-03c20b5518e7', '1079018d-4793-40cf-a48d-0007e8a5d2d1', '316314b5-7b20-4ce0-8649-32134f2f91a3'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:10:31 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-569239b3-ecbd-408c-8155-54463b436540 tempest-SnapshotsActionsTest-814560929 None] Delete snapshot completed successfully. Jun 30 16:10:31 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-569239b3-ecbd-408c-8155-54463b436540 tempest-SnapshotsActionsTest-814560929 None] Lock "cinder-aeff7831-9061-4b52-a771-3013b7678d7e-delete_snapshot" released by "delete_snapshot" :: held 5.802s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:10:31 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-f2884661-efc8-4884-8142-8d7399f9315b req-4b3dfcca-0a09-4118-8fc4-9bf110765551 tempest-AttachVolumeTestJSON-1554772577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-825deee8-8c26-439a-8466-1a41a8035c99" returned: 0 in 1.124s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-f2884661-efc8-4884-8142-8d7399f9315b req-4b3dfcca-0a09-4118-8fc4-9bf110765551 tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.152s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:10:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-f2884661-efc8-4884-8142-8d7399f9315b req-4b3dfcca-0a09-4118-8fc4-9bf110765551 tempest-AttachVolumeTestJSON-1554772577 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a', 'name': 'volume-825deee8-8c26-439a-8466-1a41a8035c99', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a1b1527-ec36-49f8-993d-b85d8c2bd3ca', 'enforce_multipath': True} {{(pid=93781) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 30 16:10:31 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-f2884661-efc8-4884-8142-8d7399f9315b req-4b3dfcca-0a09-4118-8fc4-9bf110765551 tempest-AttachVolumeTestJSON-1554772577 None] attachment_update completed successfully. Jun 30 16:10:32 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-42a4c951-ee9d-40f8-8711-f2d6bd2a519f tempest-SnapshotsActionsTest-500803998 None] Acquiring lock "cinder-0a16da40-b707-4e31-a210-75f0a0ce7917-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:10:32 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-42a4c951-ee9d-40f8-8711-f2d6bd2a519f tempest-SnapshotsActionsTest-500803998 None] Lock "cinder-0a16da40-b707-4e31-a210-75f0a0ce7917-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:10:32 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-42a4c951-ee9d-40f8-8711-f2d6bd2a519f tempest-SnapshotsActionsTest-500803998 None] Acquiring lock "cinder-quobyte-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:10:32 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-42a4c951-ee9d-40f8-8711-f2d6bd2a519f tempest-SnapshotsActionsTest-500803998 None] Lock "cinder-quobyte-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:10:32 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-42a4c951-ee9d-40f8-8711-f2d6bd2a519f tempest-SnapshotsActionsTest-500803998 None] Acquiring lock "cinder-quobyte-0a16da40-b707-4e31-a210-75f0a0ce7917" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:10:32 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-42a4c951-ee9d-40f8-8711-f2d6bd2a519f tempest-SnapshotsActionsTest-500803998 None] Lock "cinder-quobyte-0a16da40-b707-4e31-a210-75f0a0ce7917" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:10:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-42a4c951-ee9d-40f8-8711-f2d6bd2a519f tempest-SnapshotsActionsTest-500803998 None] Deleting offline snapshot 0a16da40-b707-4e31-a210-75f0a0ce7917 of volume 0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:10:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-42a4c951-ee9d-40f8-8711-f2d6bd2a519f tempest-SnapshotsActionsTest-500803998 None] snapshot_file for this snap is: volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:10:32 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[52263ace-d214-4493-919a-4b721bcbfbdc]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:10:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-42a4c951-ee9d-40f8-8711-f2d6bd2a519f tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Flow 'volume_create_manager' (e1b18c65-f4cb-421d-bc48-645a00c6848a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b1531d8-76dc-4a51-a703-f5c86cac15f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:33 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:10:33 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b1531d8-76dc-4a51-a703-f5c86cac15f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1524196556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414cc41b-a2df-4301-be28-d7023d5fc8c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed01f0e9bfb4f489caef044b3616d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:10:33Z,use_quota=True,user_id='a6429d2ddac24e43bccb6398447adf24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ca5fb2-9984-47fe-996e-655070422955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:33 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 Jun 30 16:10:33 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ca5fb2-9984-47fe-996e-655070422955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a596ec51-de9a-45ce-8625-c903d3699035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a596ec51-de9a-45ce-8625-c903d3699035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '414cc41b-a2df-4301-be28-d7023d5fc8c3', 'volume_name': 'volume-414cc41b-a2df-4301-be28-d7023d5fc8c3', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86cbc6d4-2f67-46e7-8e91-64fcf46b8022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86cbc6d4-2f67-46e7-8e91-64fcf46b8022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a24c3d5b-d59f-454e-92fd-755bd2aa526f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:33 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Volume 414cc41b-a2df-4301-be28-d7023d5fc8c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-414cc41b-a2df-4301-be28-d7023d5fc8c3', 'volume_size': 1} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1524196556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414cc41b-a2df-4301-be28-d7023d5fc8c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed01f0e9bfb4f489caef044b3616d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:10:33Z,use_quota=True,user_id='a6429d2ddac24e43bccb6398447adf24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Creating volume 414cc41b-a2df-4301-be28-d7023d5fc8c3 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:10:33 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:10:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-414cc41b-a2df-4301-be28-d7023d5fc8c3 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:33 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-414cc41b-a2df-4301-be28-d7023d5fc8c3 1073741824 Jun 30 16:10:33 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:34 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-42a4c951-ee9d-40f8-8711-f2d6bd2a519f tempest-SnapshotsActionsTest-500803998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917" returned: 0 in 1.273s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-42a4c951-ee9d-40f8-8711-f2d6bd2a519f tempest-SnapshotsActionsTest-500803998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:10:34 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcca6f5-f89e-4d70-8154-9efee3acba98]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:10:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-42a4c951-ee9d-40f8-8711-f2d6bd2a519f tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:34 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.279s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:34 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:10:34 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:10:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 8 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:10:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:10:34 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 Jun 30 16:10:34 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:34 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-414cc41b-a2df-4301-be28-d7023d5fc8c3 1073741824" returned: 0 in 1.489s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-414cc41b-a2df-4301-be28-d7023d5fc8c3 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:34 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-414cc41b-a2df-4301-be28-d7023d5fc8c3 Jun 30 16:10:34 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:35 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-42a4c951-ee9d-40f8-8711-f2d6bd2a519f tempest-SnapshotsActionsTest-500803998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589" returned: 0 in 1.016s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-42a4c951-ee9d-40f8-8711-f2d6bd2a519f tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:35 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 Jun 30 16:10:35 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:35 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-414cc41b-a2df-4301-be28-d7023d5fc8c3" returned: 0 in 0.818s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:35 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] <== create_volume: return (2377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:10:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.380s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:10:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a24c3d5b-d59f-454e-92fd-755bd2aa526f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-414cc41b-a2df-4301-be28-d7023d5fc8c3', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7051b7b-5bed-41ab-9761-f8062a3b3f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:35 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Volume volume-414cc41b-a2df-4301-be28-d7023d5fc8c3 (414cc41b-a2df-4301-be28-d7023d5fc8c3): created successfully Jun 30 16:10:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7051b7b-5bed-41ab-9761-f8062a3b3f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Flow 'volume_create_manager' (e1b18c65-f4cb-421d-bc48-645a00c6848a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:10:35 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-bc7facdb-dc8b-4c1b-9bb3-c37da54f30a7 tempest-ServerRescueNegativeTestJSON-21149133 None] Created volume successfully. Jun 30 16:10:36 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-42a4c951-ee9d-40f8-8711-f2d6bd2a519f tempest-SnapshotsActionsTest-500803998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917" returned: 0 in 1.131s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-42a4c951-ee9d-40f8-8711-f2d6bd2a519f tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:36 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917 Jun 30 16:10:36 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:38 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-42a4c951-ee9d-40f8-8711-f2d6bd2a519f tempest-SnapshotsActionsTest-500803998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589.0a16da40-b707-4e31-a210-75f0a0ce7917" returned: 0 in 1.615s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-42a4c951-ee9d-40f8-8711-f2d6bd2a519f tempest-SnapshotsActionsTest-500803998 None] Lock "cinder-quobyte-0a16da40-b707-4e31-a210-75f0a0ce7917" released by "_delete_snapshot" :: held 5.268s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:10:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-42a4c951-ee9d-40f8-8711-f2d6bd2a519f tempest-SnapshotsActionsTest-500803998 None] Lock "cinder-quobyte-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589" released by "delete_snapshot" :: held 5.329s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:10:38 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-42a4c951-ee9d-40f8-8711-f2d6bd2a519f tempest-SnapshotsActionsTest-500803998 None] Created reservations ['085f89b5-6e2d-4099-b30d-b1bb7632aedc', 'e4797132-768b-4bb4-81f7-ef0e143154f4', '831c9d11-91d7-4144-91e5-c10af9e6421b', '9f84fffb-b5bf-40fa-8ee6-76066b24f057'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:10:38 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-42a4c951-ee9d-40f8-8711-f2d6bd2a519f tempest-SnapshotsActionsTest-500803998 None] Delete snapshot completed successfully. Jun 30 16:10:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-42a4c951-ee9d-40f8-8711-f2d6bd2a519f tempest-SnapshotsActionsTest-500803998 None] Lock "cinder-0a16da40-b707-4e31-a210-75f0a0ce7917-delete_snapshot" released by "delete_snapshot" :: held 5.757s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:10:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ba9172d3-8319-49df-806c-e11928c07d7f tempest-SnapshotsActionsTest-500803998 None] Acquiring lock "cinder-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:10:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ba9172d3-8319-49df-806c-e11928c07d7f tempest-SnapshotsActionsTest-500803998 None] Lock "cinder-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:10:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ba9172d3-8319-49df-806c-e11928c07d7f tempest-SnapshotsActionsTest-500803998 None] Acquiring lock "cinder-quobyte-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:10:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ba9172d3-8319-49df-806c-e11928c07d7f tempest-SnapshotsActionsTest-500803998 None] Lock "cinder-quobyte-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589" acquired by "delete_volume" :: waited 0.060s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:10:39 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2aaa72-1231-48cc-b873-85d598fd3ca4]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:10:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ba9172d3-8319-49df-806c-e11928c07d7f tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:40 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 Jun 30 16:10:40 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:42 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ba9172d3-8319-49df-806c-e11928c07d7f tempest-SnapshotsActionsTest-500803998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589" returned: 0 in 2.383s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ba9172d3-8319-49df-806c-e11928c07d7f tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:42 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589 Jun 30 16:10:42 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:43 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ba9172d3-8319-49df-806c-e11928c07d7f tempest-SnapshotsActionsTest-500803998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589" returned: 0 in 1.298s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:43 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ba9172d3-8319-49df-806c-e11928c07d7f tempest-SnapshotsActionsTest-500803998 None] Lock "cinder-quobyte-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589" released by "delete_volume" :: held 3.832s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:10:43 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-ba9172d3-8319-49df-806c-e11928c07d7f tempest-SnapshotsActionsTest-500803998 None] Created reservations ['2e0d59bd-b3c4-4184-9dfe-e4fa5bcfc38e', '1ce8983e-2671-433e-8c8d-d689fb5e609a', '3abb8cd2-5695-4b0c-83f1-825872b55fd9', '357fec2d-fdba-47c3-9b10-c63f1a959e7a'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:10:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ba9172d3-8319-49df-806c-e11928c07d7f tempest-SnapshotsActionsTest-500803998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:10:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ba9172d3-8319-49df-806c-e11928c07d7f tempest-SnapshotsActionsTest-500803998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:10:44 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ba9172d3-8319-49df-806c-e11928c07d7f tempest-SnapshotsActionsTest-500803998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:10:44 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ba9172d3-8319-49df-806c-e11928c07d7f tempest-SnapshotsActionsTest-500803998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:10:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ba9172d3-8319-49df-806c-e11928c07d7f tempest-SnapshotsActionsTest-500803998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:10:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ba9172d3-8319-49df-806c-e11928c07d7f tempest-SnapshotsActionsTest-500803998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:44 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:10:44 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:44 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ba9172d3-8319-49df-806c-e11928c07d7f tempest-SnapshotsActionsTest-500803998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.920s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:44 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-ba9172d3-8319-49df-806c-e11928c07d7f tempest-SnapshotsActionsTest-500803998 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:10:44 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-ba9172d3-8319-49df-806c-e11928c07d7f tempest-SnapshotsActionsTest-500803998 None] Deleted volume successfully. Jun 30 16:10:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ba9172d3-8319-49df-806c-e11928c07d7f tempest-SnapshotsActionsTest-500803998 None] Lock "cinder-0196cd8c-c8ec-4d90-8c6d-b2f309ca7589-delete_volume" released by "delete_volume" :: held 5.412s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:10:52 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:10:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Flow 'volume_create_manager' (845c4ac9-5e9d-45b6-ac19-3169a94f4b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:10:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2b4fa6-6c2e-4a6b-8fbd-b9d71155824d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2b4fa6-6c2e-4a6b-8fbd-b9d71155824d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2027354040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=772723f2-a7c3-4c01-9964-dd9616e56dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce58ee5efd74f09b005983a0a12f454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:10:53Z,use_quota=True,user_id='443c0a2e3cae40229847090257f6eff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e507c098-6c42-46ff-a7f9-a49bc60d72b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e507c098-6c42-46ff-a7f9-a49bc60d72b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c493a9-b8ac-46b7-a80b-c64ba3b2ca6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c493a9-b8ac-46b7-a80b-c64ba3b2ca6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '772723f2-a7c3-4c01-9964-dd9616e56dcf', 'volume_name': 'volume-772723f2-a7c3-4c01-9964-dd9616e56dcf', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567fe6a2-7231-4e33-86e3-ddd498849721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567fe6a2-7231-4e33-86e3-ddd498849721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858a8b52-b06e-4e00-8a06-4fd54df7460e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:52 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Volume 772723f2-a7c3-4c01-9964-dd9616e56dcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-772723f2-a7c3-4c01-9964-dd9616e56dcf', 'volume_size': 1} Jun 30 16:10:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:10:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:10:52 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2027354040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=772723f2-a7c3-4c01-9964-dd9616e56dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce58ee5efd74f09b005983a0a12f454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:10:53Z,use_quota=True,user_id='443c0a2e3cae40229847090257f6eff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:10:52 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Creating volume 772723f2-a7c3-4c01-9964-dd9616e56dcf {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:10:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:10:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:10:52 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:10:52 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:10:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:10:52 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:10:52 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:10:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-772723f2-a7c3-4c01-9964-dd9616e56dcf 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:52 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-772723f2-a7c3-4c01-9964-dd9616e56dcf 1073741824 Jun 30 16:10:52 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:54 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-772723f2-a7c3-4c01-9964-dd9616e56dcf 1073741824" returned: 0 in 1.405s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-772723f2-a7c3-4c01-9964-dd9616e56dcf {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:54 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-772723f2-a7c3-4c01-9964-dd9616e56dcf Jun 30 16:10:54 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:55 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-772723f2-a7c3-4c01-9964-dd9616e56dcf" returned: 0 in 1.354s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:55 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] <== create_volume: return (2838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:10:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.843s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:10:55 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858a8b52-b06e-4e00-8a06-4fd54df7460e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-772723f2-a7c3-4c01-9964-dd9616e56dcf', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:55 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f948ee0-c10a-4f8f-92c7-b3becdca93ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:10:55 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Volume volume-772723f2-a7c3-4c01-9964-dd9616e56dcf (772723f2-a7c3-4c01-9964-dd9616e56dcf): created successfully Jun 30 16:10:55 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f948ee0-c10a-4f8f-92c7-b3becdca93ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:10:55 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Flow 'volume_create_manager' (845c4ac9-5e9d-45b6-ac19-3169a94f4b5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:10:55 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-60518081-4037-4eff-986f-57fba8950608 tempest-VolumeQuotasAdminTestJSON-1735905772 None] Created volume successfully. Jun 30 16:10:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f16178e1-1a4f-4dd7-b420-227cc24a806b tempest-VolumeQuotasAdminTestJSON-1735905772 None] Acquiring lock "cinder-772723f2-a7c3-4c01-9964-dd9616e56dcf-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:10:57 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f16178e1-1a4f-4dd7-b420-227cc24a806b tempest-VolumeQuotasAdminTestJSON-1735905772 None] Lock "cinder-772723f2-a7c3-4c01-9964-dd9616e56dcf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:10:57 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f16178e1-1a4f-4dd7-b420-227cc24a806b tempest-VolumeQuotasAdminTestJSON-1735905772 None] Acquiring lock "cinder-quobyte-772723f2-a7c3-4c01-9964-dd9616e56dcf" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:10:57 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f16178e1-1a4f-4dd7-b420-227cc24a806b tempest-VolumeQuotasAdminTestJSON-1735905772 None] Lock "cinder-quobyte-772723f2-a7c3-4c01-9964-dd9616e56dcf" acquired by "delete_volume" :: waited 0.023s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:10:57 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf8faeb-b009-4e9f-99f7-bea87a430a15]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:10:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f16178e1-1a4f-4dd7-b420-227cc24a806b tempest-VolumeQuotasAdminTestJSON-1735905772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-772723f2-a7c3-4c01-9964-dd9616e56dcf {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:57 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-772723f2-a7c3-4c01-9964-dd9616e56dcf Jun 30 16:10:57 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:58 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f16178e1-1a4f-4dd7-b420-227cc24a806b tempest-VolumeQuotasAdminTestJSON-1735905772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-772723f2-a7c3-4c01-9964-dd9616e56dcf" returned: 0 in 1.262s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f16178e1-1a4f-4dd7-b420-227cc24a806b tempest-VolumeQuotasAdminTestJSON-1735905772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-772723f2-a7c3-4c01-9964-dd9616e56dcf {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:58 devstack sudo[101321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-772723f2-a7c3-4c01-9964-dd9616e56dcf Jun 30 16:10:58 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:59 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-27c12457-ecc4-473b-a721-f128095f16d8 tempest-ServerRescueNegativeTestJSON-21149133 None] Acquiring lock "cinder-414cc41b-a2df-4301-be28-d7023d5fc8c3-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:10:59 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-27c12457-ecc4-473b-a721-f128095f16d8 tempest-ServerRescueNegativeTestJSON-21149133 None] Lock "cinder-414cc41b-a2df-4301-be28-d7023d5fc8c3-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:10:59 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-27c12457-ecc4-473b-a721-f128095f16d8 tempest-ServerRescueNegativeTestJSON-21149133 None] Acquiring lock "cinder-quobyte-414cc41b-a2df-4301-be28-d7023d5fc8c3" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:10:59 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-27c12457-ecc4-473b-a721-f128095f16d8 tempest-ServerRescueNegativeTestJSON-21149133 None] Lock "cinder-quobyte-414cc41b-a2df-4301-be28-d7023d5fc8c3" acquired by "delete_volume" :: waited 0.048s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:10:59 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b5115e-bf03-45ec-8742-502b582ed33c]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:10:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-27c12457-ecc4-473b-a721-f128095f16d8 tempest-ServerRescueNegativeTestJSON-21149133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-414cc41b-a2df-4301-be28-d7023d5fc8c3 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:10:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f16178e1-1a4f-4dd7-b420-227cc24a806b tempest-VolumeQuotasAdminTestJSON-1735905772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-772723f2-a7c3-4c01-9964-dd9616e56dcf" returned: 0 in 1.113s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:10:59 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root Jun 30 16:10:59 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f16178e1-1a4f-4dd7-b420-227cc24a806b tempest-VolumeQuotasAdminTestJSON-1735905772 None] Lock "cinder-quobyte-772723f2-a7c3-4c01-9964-dd9616e56dcf" released by "delete_volume" :: held 2.466s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:10:59 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-414cc41b-a2df-4301-be28-d7023d5fc8c3 Jun 30 16:10:59 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:10:59 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-f16178e1-1a4f-4dd7-b420-227cc24a806b tempest-VolumeQuotasAdminTestJSON-1735905772 None] Created reservations ['89f786ce-04f5-40cd-a2df-8b0e20d9b720', '9bce01b1-6056-4c8f-b38a-46f9eff91186', 'd99afed5-f6fe-4449-b408-0df28e221dfd', 'be1d01d8-10f4-4abd-9755-f0e0e3148ae1'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:10:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f16178e1-1a4f-4dd7-b420-227cc24a806b tempest-VolumeQuotasAdminTestJSON-1735905772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:10:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f16178e1-1a4f-4dd7-b420-227cc24a806b tempest-VolumeQuotasAdminTestJSON-1735905772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:10:59 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f16178e1-1a4f-4dd7-b420-227cc24a806b tempest-VolumeQuotasAdminTestJSON-1735905772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:10:59 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f16178e1-1a4f-4dd7-b420-227cc24a806b tempest-VolumeQuotasAdminTestJSON-1735905772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:10:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f16178e1-1a4f-4dd7-b420-227cc24a806b tempest-VolumeQuotasAdminTestJSON-1735905772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:10:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f16178e1-1a4f-4dd7-b420-227cc24a806b tempest-VolumeQuotasAdminTestJSON-1735905772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:00 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:11:00 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:01 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f16178e1-1a4f-4dd7-b420-227cc24a806b tempest-VolumeQuotasAdminTestJSON-1735905772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.164s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:01 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-f16178e1-1a4f-4dd7-b420-227cc24a806b tempest-VolumeQuotasAdminTestJSON-1735905772 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:11:01 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-f16178e1-1a4f-4dd7-b420-227cc24a806b tempest-VolumeQuotasAdminTestJSON-1735905772 None] Deleted volume successfully. Jun 30 16:11:01 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-27c12457-ecc4-473b-a721-f128095f16d8 tempest-ServerRescueNegativeTestJSON-21149133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-414cc41b-a2df-4301-be28-d7023d5fc8c3" returned: 0 in 1.724s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-27c12457-ecc4-473b-a721-f128095f16d8 tempest-ServerRescueNegativeTestJSON-21149133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-414cc41b-a2df-4301-be28-d7023d5fc8c3 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f16178e1-1a4f-4dd7-b420-227cc24a806b tempest-VolumeQuotasAdminTestJSON-1735905772 None] Lock "cinder-772723f2-a7c3-4c01-9964-dd9616e56dcf-delete_volume" released by "delete_volume" :: held 4.259s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:11:01 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-414cc41b-a2df-4301-be28-d7023d5fc8c3 Jun 30 16:11:01 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Flow 'volume_create_manager' (ad33314a-94d5-48db-997f-192c6457aa9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4fd367a-0039-4a53-a4ac-21254c1eb81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4fd367a-0039-4a53-a4ac-21254c1eb81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1404488959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8941c7b-ea23-4857-b948-22275272e112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce58ee5efd74f09b005983a0a12f454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:11:02Z,use_quota=True,user_id='443c0a2e3cae40229847090257f6eff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb2fb23b-482b-49dd-806d-cd6234f88034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb2fb23b-482b-49dd-806d-cd6234f88034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9922427-e79e-4054-bd66-66f65dc46309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9922427-e79e-4054-bd66-66f65dc46309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8941c7b-ea23-4857-b948-22275272e112', 'volume_name': 'volume-e8941c7b-ea23-4857-b948-22275272e112', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4944923a-1582-4442-8641-5aac25d7a508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4944923a-1582-4442-8641-5aac25d7a508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e92b4d-26f3-4017-ae48-376e0a38249e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:02 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Volume e8941c7b-ea23-4857-b948-22275272e112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8941c7b-ea23-4857-b948-22275272e112', 'volume_size': 1} Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1404488959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8941c7b-ea23-4857-b948-22275272e112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce58ee5efd74f09b005983a0a12f454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:11:02Z,use_quota=True,user_id='443c0a2e3cae40229847090257f6eff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Creating volume e8941c7b-ea23-4857-b948-22275272e112 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:11:02 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e8941c7b-ea23-4857-b948-22275272e112 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:02 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e8941c7b-ea23-4857-b948-22275272e112 1073741824 Jun 30 16:11:02 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:02 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-27c12457-ecc4-473b-a721-f128095f16d8 tempest-ServerRescueNegativeTestJSON-21149133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-414cc41b-a2df-4301-be28-d7023d5fc8c3" returned: 0 in 1.652s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-27c12457-ecc4-473b-a721-f128095f16d8 tempest-ServerRescueNegativeTestJSON-21149133 None] Lock "cinder-quobyte-414cc41b-a2df-4301-be28-d7023d5fc8c3" released by "delete_volume" :: held 3.503s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:11:02 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-27c12457-ecc4-473b-a721-f128095f16d8 tempest-ServerRescueNegativeTestJSON-21149133 None] Created reservations ['e0c132c2-e7bb-4487-9171-4e7fdae2e0e5', '6cc64a57-4204-484f-be02-6cae991adccd', '7bf5bea1-9907-4805-9585-ebbbf44d444a', 'b1214106-9f4c-4635-88f2-73e3ac039648'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:11:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-27c12457-ecc4-473b-a721-f128095f16d8 tempest-ServerRescueNegativeTestJSON-21149133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:11:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-27c12457-ecc4-473b-a721-f128095f16d8 tempest-ServerRescueNegativeTestJSON-21149133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:11:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-27c12457-ecc4-473b-a721-f128095f16d8 tempest-ServerRescueNegativeTestJSON-21149133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:11:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-27c12457-ecc4-473b-a721-f128095f16d8 tempest-ServerRescueNegativeTestJSON-21149133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:11:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-27c12457-ecc4-473b-a721-f128095f16d8 tempest-ServerRescueNegativeTestJSON-21149133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:11:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-27c12457-ecc4-473b-a721-f128095f16d8 tempest-ServerRescueNegativeTestJSON-21149133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:03 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:11:03 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:03 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e8941c7b-ea23-4857-b948-22275272e112 1073741824" returned: 0 in 1.762s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:03 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:INSERT=21,cinder:UPDATE=83,cinder:SELECT=74,cinder:DELETE=8 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:11:03 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=78,cinder:INSERT=21,cinder:UPDATE=83 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:11:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e8941c7b-ea23-4857-b948-22275272e112 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:04 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e8941c7b-ea23-4857-b948-22275272e112 Jun 30 16:11:04 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:04 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-27c12457-ecc4-473b-a721-f128095f16d8 tempest-ServerRescueNegativeTestJSON-21149133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.387s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:04 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-27c12457-ecc4-473b-a721-f128095f16d8 tempest-ServerRescueNegativeTestJSON-21149133 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:11:04 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-27c12457-ecc4-473b-a721-f128095f16d8 tempest-ServerRescueNegativeTestJSON-21149133 None] Deleted volume successfully. Jun 30 16:11:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-27c12457-ecc4-473b-a721-f128095f16d8 tempest-ServerRescueNegativeTestJSON-21149133 None] Lock "cinder-414cc41b-a2df-4301-be28-d7023d5fc8c3-delete_volume" released by "delete_volume" :: held 5.396s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:11:05 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e8941c7b-ea23-4857-b948-22275272e112" returned: 0 in 1.313s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:05 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] <== create_volume: return (3257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:11:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.261s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:11:05 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e92b4d-26f3-4017-ae48-376e0a38249e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8941c7b-ea23-4857-b948-22275272e112', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:05 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10fb8391-67f6-4b1a-b982-d58b661cddf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:05 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Volume volume-e8941c7b-ea23-4857-b948-22275272e112 (e8941c7b-ea23-4857-b948-22275272e112): created successfully Jun 30 16:11:05 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10fb8391-67f6-4b1a-b982-d58b661cddf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:05 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Flow 'volume_create_manager' (ad33314a-94d5-48db-997f-192c6457aa9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:11:05 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-c985048e-72cb-411b-bb92-b66376c22bde tempest-VolumeQuotasAdminTestJSON-1735905772 None] Created volume successfully. Jun 30 16:11:08 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-42e3a96a-0b16-4061-975b-4f5f9db01458 tempest-VolumeQuotasAdminTestJSON-47501181 None] Transfer volume completed successfully. Jun 30 16:11:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-860369c5-ad5d-43ac-baa5-0624b1a36a9a tempest-VolumeQuotasAdminTestJSON-145553019 None] Acquiring lock "cinder-e8941c7b-ea23-4857-b948-22275272e112-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:11:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-860369c5-ad5d-43ac-baa5-0624b1a36a9a tempest-VolumeQuotasAdminTestJSON-145553019 None] Lock "cinder-e8941c7b-ea23-4857-b948-22275272e112-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:11:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-860369c5-ad5d-43ac-baa5-0624b1a36a9a tempest-VolumeQuotasAdminTestJSON-145553019 None] Acquiring lock "cinder-quobyte-e8941c7b-ea23-4857-b948-22275272e112" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:11:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-860369c5-ad5d-43ac-baa5-0624b1a36a9a tempest-VolumeQuotasAdminTestJSON-145553019 None] Lock "cinder-quobyte-e8941c7b-ea23-4857-b948-22275272e112" acquired by "delete_volume" :: waited 0.023s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:11:09 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[948939ea-036e-4d82-a000-09cc64581ca5]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:11:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-860369c5-ad5d-43ac-baa5-0624b1a36a9a tempest-VolumeQuotasAdminTestJSON-145553019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e8941c7b-ea23-4857-b948-22275272e112 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:09 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e8941c7b-ea23-4857-b948-22275272e112 Jun 30 16:11:09 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:11 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-860369c5-ad5d-43ac-baa5-0624b1a36a9a tempest-VolumeQuotasAdminTestJSON-145553019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e8941c7b-ea23-4857-b948-22275272e112" returned: 0 in 1.499s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-860369c5-ad5d-43ac-baa5-0624b1a36a9a tempest-VolumeQuotasAdminTestJSON-145553019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e8941c7b-ea23-4857-b948-22275272e112 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:11 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e8941c7b-ea23-4857-b948-22275272e112 Jun 30 16:11:11 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:12 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-860369c5-ad5d-43ac-baa5-0624b1a36a9a tempest-VolumeQuotasAdminTestJSON-145553019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e8941c7b-ea23-4857-b948-22275272e112" returned: 0 in 1.064s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-860369c5-ad5d-43ac-baa5-0624b1a36a9a tempest-VolumeQuotasAdminTestJSON-145553019 None] Lock "cinder-quobyte-e8941c7b-ea23-4857-b948-22275272e112" released by "delete_volume" :: held 2.708s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:11:12 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-860369c5-ad5d-43ac-baa5-0624b1a36a9a tempest-VolumeQuotasAdminTestJSON-145553019 None] Created reservations ['4e680dcc-9e1c-4f5f-b898-aa4d37ce3172', '174e5eba-cae7-49fb-bdfe-ad15417b29d4', 'e96aa2c5-2671-4fb8-b7f8-2d72efe2ea35', 'c9edec48-5310-412b-96e3-d6a97df01621'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:11:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-860369c5-ad5d-43ac-baa5-0624b1a36a9a tempest-VolumeQuotasAdminTestJSON-145553019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:11:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-860369c5-ad5d-43ac-baa5-0624b1a36a9a tempest-VolumeQuotasAdminTestJSON-145553019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:11:12 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-860369c5-ad5d-43ac-baa5-0624b1a36a9a tempest-VolumeQuotasAdminTestJSON-145553019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:11:12 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-860369c5-ad5d-43ac-baa5-0624b1a36a9a tempest-VolumeQuotasAdminTestJSON-145553019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:11:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-860369c5-ad5d-43ac-baa5-0624b1a36a9a tempest-VolumeQuotasAdminTestJSON-145553019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:11:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-860369c5-ad5d-43ac-baa5-0624b1a36a9a tempest-VolumeQuotasAdminTestJSON-145553019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:12 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:11:12 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:13 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-860369c5-ad5d-43ac-baa5-0624b1a36a9a tempest-VolumeQuotasAdminTestJSON-145553019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.019s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:13 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-860369c5-ad5d-43ac-baa5-0624b1a36a9a tempest-VolumeQuotasAdminTestJSON-145553019 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:11:13 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-860369c5-ad5d-43ac-baa5-0624b1a36a9a tempest-VolumeQuotasAdminTestJSON-145553019 None] Deleted volume successfully. Jun 30 16:11:13 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-860369c5-ad5d-43ac-baa5-0624b1a36a9a tempest-VolumeQuotasAdminTestJSON-145553019 None] Lock "cinder-e8941c7b-ea23-4857-b948-22275272e112-delete_volume" released by "delete_volume" :: held 4.097s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:11:16 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:11:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Flow 'volume_create_manager' (acb1b36d-1766-4b0c-851a-fb580e19725e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:11:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6522dbd5-e8ad-49dd-ac27-8e0e4ca35115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6522dbd5-e8ad-49dd-ac27-8e0e4ca35115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1765612260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075d331a-a98f-49a4-8765-892c3e51491b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a00f6ee30dd4b29a3bdbfae8f275252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:11:16Z,use_quota=True,user_id='93f73473b7ac41f39436c9f82396922e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1c263c-bb21-4df8-bddf-ec3ef32bf7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1c263c-bb21-4df8-bddf-ec3ef32bf7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0fed53-80e8-420f-bafd-de3a70477bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0fed53-80e8-420f-bafd-de3a70477bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '075d331a-a98f-49a4-8765-892c3e51491b', 'volume_name': 'volume-075d331a-a98f-49a4-8765-892c3e51491b', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab10b78a-438a-4697-af0f-383d0069f66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab10b78a-438a-4697-af0f-383d0069f66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e58e609c-fe19-4794-b806-804acac9ae17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:16 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Volume 075d331a-a98f-49a4-8765-892c3e51491b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-075d331a-a98f-49a4-8765-892c3e51491b', 'volume_size': 1} Jun 30 16:11:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:11:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:11:16 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1765612260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075d331a-a98f-49a4-8765-892c3e51491b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a00f6ee30dd4b29a3bdbfae8f275252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:11:16Z,use_quota=True,user_id='93f73473b7ac41f39436c9f82396922e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:11:16 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Creating volume 075d331a-a98f-49a4-8765-892c3e51491b {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:11:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:11:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:11:16 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:11:16 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:11:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:11:16 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:11:16 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:11:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-075d331a-a98f-49a4-8765-892c3e51491b 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:16 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-075d331a-a98f-49a4-8765-892c3e51491b 1073741824 Jun 30 16:11:16 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:17 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-075d331a-a98f-49a4-8765-892c3e51491b 1073741824" returned: 0 in 0.979s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-075d331a-a98f-49a4-8765-892c3e51491b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:17 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-075d331a-a98f-49a4-8765-892c3e51491b Jun 30 16:11:17 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:18 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-075d331a-a98f-49a4-8765-892c3e51491b" returned: 0 in 0.693s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:18 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:11:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:11:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e58e609c-fe19-4794-b806-804acac9ae17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-075d331a-a98f-49a4-8765-892c3e51491b', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e495cd-013a-4046-8aa2-1083dedfeb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:18 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Volume volume-075d331a-a98f-49a4-8765-892c3e51491b (075d331a-a98f-49a4-8765-892c3e51491b): created successfully Jun 30 16:11:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e495cd-013a-4046-8aa2-1083dedfeb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Flow 'volume_create_manager' (acb1b36d-1766-4b0c-851a-fb580e19725e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:11:18 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-f426e9f8-b6a2-4c32-bf42-b74688de1508 tempest-VolumeQuotasNegativeTestJSON-98128518 None] Created volume successfully. Jun 30 16:11:19 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-86d97a0c-47b7-4fdd-bed7-5ba92407262f tempest-VolumeQuotasNegativeTestJSON-98128518 None] Acquiring lock "cinder-075d331a-a98f-49a4-8765-892c3e51491b-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:11:19 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-86d97a0c-47b7-4fdd-bed7-5ba92407262f tempest-VolumeQuotasNegativeTestJSON-98128518 None] Lock "cinder-075d331a-a98f-49a4-8765-892c3e51491b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:11:19 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-86d97a0c-47b7-4fdd-bed7-5ba92407262f tempest-VolumeQuotasNegativeTestJSON-98128518 None] Acquiring lock "cinder-quobyte-075d331a-a98f-49a4-8765-892c3e51491b" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:11:19 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-86d97a0c-47b7-4fdd-bed7-5ba92407262f tempest-VolumeQuotasNegativeTestJSON-98128518 None] Lock "cinder-quobyte-075d331a-a98f-49a4-8765-892c3e51491b" acquired by "delete_volume" :: waited 0.030s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:11:19 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bc07fc-67f3-48c0-90ff-f6c8557d5455]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:11:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86d97a0c-47b7-4fdd-bed7-5ba92407262f tempest-VolumeQuotasNegativeTestJSON-98128518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-075d331a-a98f-49a4-8765-892c3e51491b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:19 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-075d331a-a98f-49a4-8765-892c3e51491b Jun 30 16:11:19 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:20 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86d97a0c-47b7-4fdd-bed7-5ba92407262f tempest-VolumeQuotasNegativeTestJSON-98128518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-075d331a-a98f-49a4-8765-892c3e51491b" returned: 0 in 0.934s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86d97a0c-47b7-4fdd-bed7-5ba92407262f tempest-VolumeQuotasNegativeTestJSON-98128518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-075d331a-a98f-49a4-8765-892c3e51491b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:20 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-075d331a-a98f-49a4-8765-892c3e51491b Jun 30 16:11:20 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:21 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86d97a0c-47b7-4fdd-bed7-5ba92407262f tempest-VolumeQuotasNegativeTestJSON-98128518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-075d331a-a98f-49a4-8765-892c3e51491b" returned: 0 in 0.777s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-86d97a0c-47b7-4fdd-bed7-5ba92407262f tempest-VolumeQuotasNegativeTestJSON-98128518 None] Lock "cinder-quobyte-075d331a-a98f-49a4-8765-892c3e51491b" released by "delete_volume" :: held 1.785s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:11:21 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-86d97a0c-47b7-4fdd-bed7-5ba92407262f tempest-VolumeQuotasNegativeTestJSON-98128518 None] Created reservations ['61563058-f5c7-42c0-a43c-10f9713a2100', 'aa7d8a0f-458c-4118-ab25-22bfc551c12d', '415ffc8e-005a-4856-86b6-fb1607a8a995', 'f0ff5695-59c4-4991-9fb8-53b7dd4fca09'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:11:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-86d97a0c-47b7-4fdd-bed7-5ba92407262f tempest-VolumeQuotasNegativeTestJSON-98128518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:11:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-86d97a0c-47b7-4fdd-bed7-5ba92407262f tempest-VolumeQuotasNegativeTestJSON-98128518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:11:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-86d97a0c-47b7-4fdd-bed7-5ba92407262f tempest-VolumeQuotasNegativeTestJSON-98128518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:11:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-86d97a0c-47b7-4fdd-bed7-5ba92407262f tempest-VolumeQuotasNegativeTestJSON-98128518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:11:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-86d97a0c-47b7-4fdd-bed7-5ba92407262f tempest-VolumeQuotasNegativeTestJSON-98128518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:11:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86d97a0c-47b7-4fdd-bed7-5ba92407262f tempest-VolumeQuotasNegativeTestJSON-98128518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:21 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:11:21 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:22 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86d97a0c-47b7-4fdd-bed7-5ba92407262f tempest-VolumeQuotasNegativeTestJSON-98128518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.031s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:22 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-86d97a0c-47b7-4fdd-bed7-5ba92407262f tempest-VolumeQuotasNegativeTestJSON-98128518 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:11:22 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-86d97a0c-47b7-4fdd-bed7-5ba92407262f tempest-VolumeQuotasNegativeTestJSON-98128518 None] Deleted volume successfully. Jun 30 16:11:22 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-86d97a0c-47b7-4fdd-bed7-5ba92407262f tempest-VolumeQuotasNegativeTestJSON-98128518 None] Lock "cinder-075d331a-a98f-49a4-8765-892c3e51491b-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:11:24 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-e2075c7f-eb49-4a9e-a392-5a14c4d37971 req-41383a85-6b09-4a5a-81c8-0d926cc3c5ee tempest-AttachVolumeTestJSON-1554772577 None] Terminate volume connection completed successfully. Jun 30 16:11:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-e2075c7f-eb49-4a9e-a392-5a14c4d37971 req-41383a85-6b09-4a5a-81c8-0d926cc3c5ee tempest-AttachVolumeTestJSON-1554772577 None] Deleting attachment 3a1b1527-ec36-49f8-993d-b85d8c2bd3ca. {{(pid=93781) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 30 16:11:24 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:11:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Flow 'volume_create_manager' (56f2e330-5cc4-49a7-92d9-12f69b63cdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:11:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb859aa-c551-4d33-a59d-0765093b8987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb859aa-c551-4d33-a59d-0765093b8987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1350648214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8155e339-9d60-4c9d-b408-e0ed62514a5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99034fdf80a644f3969535fa2e0c5067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:11:25Z,use_quota=True,user_id='8d387c7d4dfd486c9cd1a6ee180360de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (790fdbc3-37ac-4405-87eb-73109b4d78d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (790fdbc3-37ac-4405-87eb-73109b4d78d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7651c2-7ac7-444f-a0d2-3d73dfac559a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7651c2-7ac7-444f-a0d2-3d73dfac559a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8155e339-9d60-4c9d-b408-e0ed62514a5e', 'volume_name': 'volume-8155e339-9d60-4c9d-b408-e0ed62514a5e', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11e02ff-87db-4901-a110-75cfe2b0bca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11e02ff-87db-4901-a110-75cfe2b0bca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0781689-dcd7-47b1-8982-c58947294b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:24 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Volume 8155e339-9d60-4c9d-b408-e0ed62514a5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8155e339-9d60-4c9d-b408-e0ed62514a5e', 'volume_size': 1} Jun 30 16:11:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:11:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:11:24 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1350648214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8155e339-9d60-4c9d-b408-e0ed62514a5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99034fdf80a644f3969535fa2e0c5067',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:11:25Z,use_quota=True,user_id='8d387c7d4dfd486c9cd1a6ee180360de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:11:24 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Creating volume 8155e339-9d60-4c9d-b408-e0ed62514a5e {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:11:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:11:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:11:24 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:11:24 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:11:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:11:24 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:11:24 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:11:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8155e339-9d60-4c9d-b408-e0ed62514a5e 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:25 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8155e339-9d60-4c9d-b408-e0ed62514a5e 1073741824 Jun 30 16:11:25 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:26 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8155e339-9d60-4c9d-b408-e0ed62514a5e 1073741824" returned: 0 in 1.244s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8155e339-9d60-4c9d-b408-e0ed62514a5e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:26 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8155e339-9d60-4c9d-b408-e0ed62514a5e Jun 30 16:11:26 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:27 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8155e339-9d60-4c9d-b408-e0ed62514a5e" returned: 0 in 0.857s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:27 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] <== create_volume: return (2155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:11:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.157s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:11:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0781689-dcd7-47b1-8982-c58947294b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8155e339-9d60-4c9d-b408-e0ed62514a5e', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832858fd-1117-47ae-a2c5-a9aab1baa19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:27 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Volume volume-8155e339-9d60-4c9d-b408-e0ed62514a5e (8155e339-9d60-4c9d-b408-e0ed62514a5e): created successfully Jun 30 16:11:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832858fd-1117-47ae-a2c5-a9aab1baa19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Flow 'volume_create_manager' (56f2e330-5cc4-49a7-92d9-12f69b63cdbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:11:27 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-1051a011-d8a2-4f3c-957d-14a160b0a02a tempest-VolumesMetadataTest-1867219592 None] Created volume successfully. Jun 30 16:11:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9e85a49d-fcaf-4012-a551-a71b649ea7ae tempest-VolumesMetadataTest-1867219592 None] Acquiring lock "cinder-8155e339-9d60-4c9d-b408-e0ed62514a5e-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:11:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9e85a49d-fcaf-4012-a551-a71b649ea7ae tempest-VolumesMetadataTest-1867219592 None] Lock "cinder-8155e339-9d60-4c9d-b408-e0ed62514a5e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:11:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9e85a49d-fcaf-4012-a551-a71b649ea7ae tempest-VolumesMetadataTest-1867219592 None] Acquiring lock "cinder-quobyte-8155e339-9d60-4c9d-b408-e0ed62514a5e" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:11:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9e85a49d-fcaf-4012-a551-a71b649ea7ae tempest-VolumesMetadataTest-1867219592 None] Lock "cinder-quobyte-8155e339-9d60-4c9d-b408-e0ed62514a5e" acquired by "delete_volume" :: waited 0.030s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:11:29 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa60e643-890e-4fe4-9871-48fc5eda2b52]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:11:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9e85a49d-fcaf-4012-a551-a71b649ea7ae tempest-VolumesMetadataTest-1867219592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8155e339-9d60-4c9d-b408-e0ed62514a5e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:29 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8155e339-9d60-4c9d-b408-e0ed62514a5e Jun 30 16:11:29 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:30 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9e85a49d-fcaf-4012-a551-a71b649ea7ae tempest-VolumesMetadataTest-1867219592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8155e339-9d60-4c9d-b408-e0ed62514a5e" returned: 0 in 0.951s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9e85a49d-fcaf-4012-a551-a71b649ea7ae tempest-VolumesMetadataTest-1867219592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8155e339-9d60-4c9d-b408-e0ed62514a5e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:30 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8155e339-9d60-4c9d-b408-e0ed62514a5e Jun 30 16:11:30 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Flow 'volume_create_manager' (b34f03af-b386-4d43-9860-8c5c7bbbd340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06baa94a-e18b-4dd4-a565-24125472e3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06baa94a-e18b-4dd4-a565-24125472e3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-156377321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef35b9b-17e8-4829-9a28-26d1491ee992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc035d7c6f742e1972794b23603e648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:11:31Z,use_quota=True,user_id='eec93b6a06a34e76be4cb704107b201c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d4b75b-cc43-42c0-a977-7f99f5d4daec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d4b75b-cc43-42c0-a977-7f99f5d4daec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76036c2-afcc-4eaa-bb57-9932fb9da5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76036c2-afcc-4eaa-bb57-9932fb9da5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ef35b9b-17e8-4829-9a28-26d1491ee992', 'volume_name': 'volume-8ef35b9b-17e8-4829-9a28-26d1491ee992', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25bb0947-403e-4dc5-8209-66a00336443c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25bb0947-403e-4dc5-8209-66a00336443c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e254013-d23d-4a62-800b-bb1bd4e58010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:30 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Volume 8ef35b9b-17e8-4829-9a28-26d1491ee992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ef35b9b-17e8-4829-9a28-26d1491ee992', 'volume_size': 1} Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-156377321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef35b9b-17e8-4829-9a28-26d1491ee992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc035d7c6f742e1972794b23603e648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:11:31Z,use_quota=True,user_id='eec93b6a06a34e76be4cb704107b201c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Creating volume 8ef35b9b-17e8-4829-9a28-26d1491ee992 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:11:30 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:11:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8ef35b9b-17e8-4829-9a28-26d1491ee992 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:30 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8ef35b9b-17e8-4829-9a28-26d1491ee992 1073741824 Jun 30 16:11:30 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:31 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9e85a49d-fcaf-4012-a551-a71b649ea7ae tempest-VolumesMetadataTest-1867219592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8155e339-9d60-4c9d-b408-e0ed62514a5e" returned: 0 in 0.934s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:31 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9e85a49d-fcaf-4012-a551-a71b649ea7ae tempest-VolumesMetadataTest-1867219592 None] Lock "cinder-quobyte-8155e339-9d60-4c9d-b408-e0ed62514a5e" released by "delete_volume" :: held 1.949s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:11:31 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-9e85a49d-fcaf-4012-a551-a71b649ea7ae tempest-VolumesMetadataTest-1867219592 None] Created reservations ['98ce7fb9-539a-4edf-b38e-b19a7a8c318b', '5d193cdb-da00-4c90-8cd2-82f840ff966e', 'dae23237-a505-4bec-8d1f-8f12211bb494', '2a82b631-adbc-4fdc-ba05-0d1d0a29ca00'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:11:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9e85a49d-fcaf-4012-a551-a71b649ea7ae tempest-VolumesMetadataTest-1867219592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:11:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9e85a49d-fcaf-4012-a551-a71b649ea7ae tempest-VolumesMetadataTest-1867219592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:11:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9e85a49d-fcaf-4012-a551-a71b649ea7ae tempest-VolumesMetadataTest-1867219592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:11:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9e85a49d-fcaf-4012-a551-a71b649ea7ae tempest-VolumesMetadataTest-1867219592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:11:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9e85a49d-fcaf-4012-a551-a71b649ea7ae tempest-VolumesMetadataTest-1867219592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:11:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9e85a49d-fcaf-4012-a551-a71b649ea7ae tempest-VolumesMetadataTest-1867219592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:31 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:11:31 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:32 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8ef35b9b-17e8-4829-9a28-26d1491ee992 1073741824" returned: 0 in 1.260s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8ef35b9b-17e8-4829-9a28-26d1491ee992 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:32 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8ef35b9b-17e8-4829-9a28-26d1491ee992 Jun 30 16:11:32 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:32 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9e85a49d-fcaf-4012-a551-a71b649ea7ae tempest-VolumesMetadataTest-1867219592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.181s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:32 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-9e85a49d-fcaf-4012-a551-a71b649ea7ae tempest-VolumesMetadataTest-1867219592 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:11:32 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-9e85a49d-fcaf-4012-a551-a71b649ea7ae tempest-VolumesMetadataTest-1867219592 None] Deleted volume successfully. Jun 30 16:11:32 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9e85a49d-fcaf-4012-a551-a71b649ea7ae tempest-VolumesMetadataTest-1867219592 None] Lock "cinder-8155e339-9d60-4c9d-b408-e0ed62514a5e-delete_volume" released by "delete_volume" :: held 3.455s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:11:33 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8ef35b9b-17e8-4829-9a28-26d1491ee992" returned: 0 in 0.890s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] <== create_volume: return (2220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:11:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.222s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:11:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e254013-d23d-4a62-800b-bb1bd4e58010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ef35b9b-17e8-4829-9a28-26d1491ee992', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (168088d5-4c43-4652-b297-def76fb1aabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:11:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:11:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:11:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:11:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:11:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:11:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:33 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Volume volume-8ef35b9b-17e8-4829-9a28-26d1491ee992 (8ef35b9b-17e8-4829-9a28-26d1491ee992): created successfully Jun 30 16:11:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (168088d5-4c43-4652-b297-def76fb1aabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Flow 'volume_create_manager' (b34f03af-b386-4d43-9860-8c5c7bbbd340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:11:33 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:11:33 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:33 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-7643ab82-6b09-4b23-abfb-ad210fb03a66 tempest-VolumesServicesTestJSON-1475636579 None] Created volume successfully. Jun 30 16:11:33 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.803s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:33 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:11:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:11:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 8 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:11:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:11:34 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3b65e1e0-f273-49f3-ad29-db4c2ffaec6a tempest-VolumesServicesTestJSON-1475636579 None] Acquiring lock "cinder-8ef35b9b-17e8-4829-9a28-26d1491ee992-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:11:34 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3b65e1e0-f273-49f3-ad29-db4c2ffaec6a tempest-VolumesServicesTestJSON-1475636579 None] Lock "cinder-8ef35b9b-17e8-4829-9a28-26d1491ee992-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:11:34 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3b65e1e0-f273-49f3-ad29-db4c2ffaec6a tempest-VolumesServicesTestJSON-1475636579 None] Acquiring lock "cinder-quobyte-8ef35b9b-17e8-4829-9a28-26d1491ee992" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:11:34 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3b65e1e0-f273-49f3-ad29-db4c2ffaec6a tempest-VolumesServicesTestJSON-1475636579 None] Lock "cinder-quobyte-8ef35b9b-17e8-4829-9a28-26d1491ee992" acquired by "delete_volume" :: waited 0.029s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:11:34 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b001010-2406-4f43-a781-96427fbdec69]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:11:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3b65e1e0-f273-49f3-ad29-db4c2ffaec6a tempest-VolumesServicesTestJSON-1475636579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8ef35b9b-17e8-4829-9a28-26d1491ee992 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:34 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8ef35b9b-17e8-4829-9a28-26d1491ee992 Jun 30 16:11:34 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:35 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3b65e1e0-f273-49f3-ad29-db4c2ffaec6a tempest-VolumesServicesTestJSON-1475636579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8ef35b9b-17e8-4829-9a28-26d1491ee992" returned: 0 in 0.927s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3b65e1e0-f273-49f3-ad29-db4c2ffaec6a tempest-VolumesServicesTestJSON-1475636579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8ef35b9b-17e8-4829-9a28-26d1491ee992 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:35 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8ef35b9b-17e8-4829-9a28-26d1491ee992 Jun 30 16:11:35 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:36 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3b65e1e0-f273-49f3-ad29-db4c2ffaec6a tempest-VolumesServicesTestJSON-1475636579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8ef35b9b-17e8-4829-9a28-26d1491ee992" returned: 0 in 0.803s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:36 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3b65e1e0-f273-49f3-ad29-db4c2ffaec6a tempest-VolumesServicesTestJSON-1475636579 None] Lock "cinder-quobyte-8ef35b9b-17e8-4829-9a28-26d1491ee992" released by "delete_volume" :: held 1.790s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:11:36 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-3b65e1e0-f273-49f3-ad29-db4c2ffaec6a tempest-VolumesServicesTestJSON-1475636579 None] Created reservations ['c2401f8f-4c5d-4e08-840a-70040db3a0eb', 'a64b479b-5b10-4235-bbc0-14ee2594f6dc', 'd034916a-46a8-4865-a812-2eea51ac280b', 'adb5df7e-1b73-4cd8-91dd-e114357230e7'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:11:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3b65e1e0-f273-49f3-ad29-db4c2ffaec6a tempest-VolumesServicesTestJSON-1475636579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:11:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3b65e1e0-f273-49f3-ad29-db4c2ffaec6a tempest-VolumesServicesTestJSON-1475636579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:11:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3b65e1e0-f273-49f3-ad29-db4c2ffaec6a tempest-VolumesServicesTestJSON-1475636579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:11:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3b65e1e0-f273-49f3-ad29-db4c2ffaec6a tempest-VolumesServicesTestJSON-1475636579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:11:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3b65e1e0-f273-49f3-ad29-db4c2ffaec6a tempest-VolumesServicesTestJSON-1475636579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:11:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3b65e1e0-f273-49f3-ad29-db4c2ffaec6a tempest-VolumesServicesTestJSON-1475636579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:36 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:11:36 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:37 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3b65e1e0-f273-49f3-ad29-db4c2ffaec6a tempest-VolumesServicesTestJSON-1475636579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.063s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:37 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-3b65e1e0-f273-49f3-ad29-db4c2ffaec6a tempest-VolumesServicesTestJSON-1475636579 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:11:37 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-3b65e1e0-f273-49f3-ad29-db4c2ffaec6a tempest-VolumesServicesTestJSON-1475636579 None] Deleted volume successfully. Jun 30 16:11:37 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3b65e1e0-f273-49f3-ad29-db4c2ffaec6a tempest-VolumesServicesTestJSON-1475636579 None] Lock "cinder-8ef35b9b-17e8-4829-9a28-26d1491ee992-delete_volume" released by "delete_volume" :: held 3.126s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:11:38 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:11:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Flow 'volume_create_manager' (10403a4c-ffb2-44a1-b182-f55791827387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:11:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89232155-9568-49a4-8925-57c1e7d6b3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89232155-9568-49a4-8925-57c1e7d6b3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1719389476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e059af-d272-46f4-98e9-f7fe8b15dbfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12082bf49c6c403d861d6e2469a6b8b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:11:38Z,use_quota=True,user_id='ea63a069939b42ec989c7cc09317392f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42444d92-a200-4cdd-a348-20afd77285b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42444d92-a200-4cdd-a348-20afd77285b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e4289b-a6c4-49fe-a49e-14829c7262e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e4289b-a6c4-49fe-a49e-14829c7262e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22e059af-d272-46f4-98e9-f7fe8b15dbfc', 'volume_name': 'volume-22e059af-d272-46f4-98e9-f7fe8b15dbfc', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab069e5-bcd2-4bb8-98ad-99130a956214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab069e5-bcd2-4bb8-98ad-99130a956214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12562c4-da15-43fd-80c6-04cd09ebc014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:38 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Volume 22e059af-d272-46f4-98e9-f7fe8b15dbfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22e059af-d272-46f4-98e9-f7fe8b15dbfc', 'volume_size': 1} Jun 30 16:11:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:11:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:11:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1719389476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e059af-d272-46f4-98e9-f7fe8b15dbfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12082bf49c6c403d861d6e2469a6b8b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:11:38Z,use_quota=True,user_id='ea63a069939b42ec989c7cc09317392f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:11:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Creating volume 22e059af-d272-46f4-98e9-f7fe8b15dbfc {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:11:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:11:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:11:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:11:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:11:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:11:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:11:38 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:11:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-22e059af-d272-46f4-98e9-f7fe8b15dbfc 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:38 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-22e059af-d272-46f4-98e9-f7fe8b15dbfc 1073741824 Jun 30 16:11:38 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:39 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-22e059af-d272-46f4-98e9-f7fe8b15dbfc 1073741824" returned: 0 in 1.242s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-22e059af-d272-46f4-98e9-f7fe8b15dbfc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:39 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-22e059af-d272-46f4-98e9-f7fe8b15dbfc Jun 30 16:11:39 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:40 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-22e059af-d272-46f4-98e9-f7fe8b15dbfc" returned: 0 in 1.014s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] <== create_volume: return (2321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:11:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.325s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:11:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12562c4-da15-43fd-80c6-04cd09ebc014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22e059af-d272-46f4-98e9-f7fe8b15dbfc', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79054d5b-783d-4e9c-9e90-3f1e551eae70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:40 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Volume volume-22e059af-d272-46f4-98e9-f7fe8b15dbfc (22e059af-d272-46f4-98e9-f7fe8b15dbfc): created successfully Jun 30 16:11:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79054d5b-783d-4e9c-9e90-3f1e551eae70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Flow 'volume_create_manager' (10403a4c-ffb2-44a1-b182-f55791827387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:11:41 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-20cbd684-a960-41fa-93a3-c85377e1e165 tempest-VolumesTransfersV355Test-891374347 None] Created volume successfully. Jun 30 16:11:43 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-b29f204b-8c8b-4f07-a6e6-45a97d7ae683 tempest-VolumesTransfersV355Test-1974561402 None] Transfer volume completed successfully. Jun 30 16:11:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b4751f38-5144-48e8-85c2-87bd9010029d tempest-VolumesTransfersV355Test-1643515293 None] Acquiring lock "cinder-22e059af-d272-46f4-98e9-f7fe8b15dbfc-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:11:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b4751f38-5144-48e8-85c2-87bd9010029d tempest-VolumesTransfersV355Test-1643515293 None] Lock "cinder-22e059af-d272-46f4-98e9-f7fe8b15dbfc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:11:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b4751f38-5144-48e8-85c2-87bd9010029d tempest-VolumesTransfersV355Test-1643515293 None] Acquiring lock "cinder-quobyte-22e059af-d272-46f4-98e9-f7fe8b15dbfc" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:11:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b4751f38-5144-48e8-85c2-87bd9010029d tempest-VolumesTransfersV355Test-1643515293 None] Lock "cinder-quobyte-22e059af-d272-46f4-98e9-f7fe8b15dbfc" acquired by "delete_volume" :: waited 0.019s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:11:45 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7ff9db-a474-4399-a3a6-06824a930b1c]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:11:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b4751f38-5144-48e8-85c2-87bd9010029d tempest-VolumesTransfersV355Test-1643515293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-22e059af-d272-46f4-98e9-f7fe8b15dbfc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:45 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-22e059af-d272-46f4-98e9-f7fe8b15dbfc Jun 30 16:11:45 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:46 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b4751f38-5144-48e8-85c2-87bd9010029d tempest-VolumesTransfersV355Test-1643515293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-22e059af-d272-46f4-98e9-f7fe8b15dbfc" returned: 0 in 1.025s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b4751f38-5144-48e8-85c2-87bd9010029d tempest-VolumesTransfersV355Test-1643515293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-22e059af-d272-46f4-98e9-f7fe8b15dbfc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:46 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-22e059af-d272-46f4-98e9-f7fe8b15dbfc Jun 30 16:11:46 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:47 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b4751f38-5144-48e8-85c2-87bd9010029d tempest-VolumesTransfersV355Test-1643515293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-22e059af-d272-46f4-98e9-f7fe8b15dbfc" returned: 0 in 1.065s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:47 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b4751f38-5144-48e8-85c2-87bd9010029d tempest-VolumesTransfersV355Test-1643515293 None] Lock "cinder-quobyte-22e059af-d272-46f4-98e9-f7fe8b15dbfc" released by "delete_volume" :: held 2.158s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:11:47 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-b4751f38-5144-48e8-85c2-87bd9010029d tempest-VolumesTransfersV355Test-1643515293 None] Created reservations ['8799f386-9c3e-4a8e-a4a4-0a0232771322', '2a2c5cc0-72ac-4496-b4d2-aac3421d343d', '6598bc85-50d7-451a-9358-a6d6a4154b13', '53312f18-648c-4c4b-9351-20c21839ccd9'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:11:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b4751f38-5144-48e8-85c2-87bd9010029d tempest-VolumesTransfersV355Test-1643515293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:11:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b4751f38-5144-48e8-85c2-87bd9010029d tempest-VolumesTransfersV355Test-1643515293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:11:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b4751f38-5144-48e8-85c2-87bd9010029d tempest-VolumesTransfersV355Test-1643515293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:11:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b4751f38-5144-48e8-85c2-87bd9010029d tempest-VolumesTransfersV355Test-1643515293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:11:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b4751f38-5144-48e8-85c2-87bd9010029d tempest-VolumesTransfersV355Test-1643515293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:11:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b4751f38-5144-48e8-85c2-87bd9010029d tempest-VolumesTransfersV355Test-1643515293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:47 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:11:47 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:48 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b4751f38-5144-48e8-85c2-87bd9010029d tempest-VolumesTransfersV355Test-1643515293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.998s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:48 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-b4751f38-5144-48e8-85c2-87bd9010029d tempest-VolumesTransfersV355Test-1643515293 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:11:48 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-b4751f38-5144-48e8-85c2-87bd9010029d tempest-VolumesTransfersV355Test-1643515293 None] Deleted volume successfully. Jun 30 16:11:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b4751f38-5144-48e8-85c2-87bd9010029d tempest-VolumesTransfersV355Test-1643515293 None] Lock "cinder-22e059af-d272-46f4-98e9-f7fe8b15dbfc-delete_volume" released by "delete_volume" :: held 3.472s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:11:49 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:11:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Flow 'volume_create_manager' (ec0a64d9-cc30-4543-949b-c22b22347840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:11:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d14b1d-38d8-49b2-a4a3-628c65743ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d14b1d-38d8-49b2-a4a3-628c65743ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1110186773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29bcf2a6-0dcb-44d3-bb15-79ac2af3f622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12082bf49c6c403d861d6e2469a6b8b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:11:49Z,use_quota=True,user_id='ea63a069939b42ec989c7cc09317392f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e4f88e-3ad8-46c4-861e-b6dd1059695f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e4f88e-3ad8-46c4-861e-b6dd1059695f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956bdc78-3b21-4911-9983-c64521e2a3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956bdc78-3b21-4911-9983-c64521e2a3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29bcf2a6-0dcb-44d3-bb15-79ac2af3f622', 'volume_name': 'volume-29bcf2a6-0dcb-44d3-bb15-79ac2af3f622', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7af05d-f1d3-4c9b-8185-b657a6c8db02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7af05d-f1d3-4c9b-8185-b657a6c8db02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f1f027-127d-4113-a159-129f7313bcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:49 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Volume 29bcf2a6-0dcb-44d3-bb15-79ac2af3f622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29bcf2a6-0dcb-44d3-bb15-79ac2af3f622', 'volume_size': 1} Jun 30 16:11:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:11:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:11:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1110186773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29bcf2a6-0dcb-44d3-bb15-79ac2af3f622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12082bf49c6c403d861d6e2469a6b8b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:11:49Z,use_quota=True,user_id='ea63a069939b42ec989c7cc09317392f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:11:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Creating volume 29bcf2a6-0dcb-44d3-bb15-79ac2af3f622 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:11:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:11:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:11:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:11:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:11:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:11:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:11:49 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:11:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29bcf2a6-0dcb-44d3-bb15-79ac2af3f622 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:49 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29bcf2a6-0dcb-44d3-bb15-79ac2af3f622 1073741824 Jun 30 16:11:49 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29bcf2a6-0dcb-44d3-bb15-79ac2af3f622 1073741824" returned: 0 in 1.108s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:50 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29bcf2a6-0dcb-44d3-bb15-79ac2af3f622 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:50 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29bcf2a6-0dcb-44d3-bb15-79ac2af3f622 Jun 30 16:11:50 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:51 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29bcf2a6-0dcb-44d3-bb15-79ac2af3f622" returned: 0 in 1.023s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:51 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] <== create_volume: return (2208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:11:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.211s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:11:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f1f027-127d-4113-a159-129f7313bcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29bcf2a6-0dcb-44d3-bb15-79ac2af3f622', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebda40fd-acff-429b-9c0b-5f1d60c07d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:51 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Volume volume-29bcf2a6-0dcb-44d3-bb15-79ac2af3f622 (29bcf2a6-0dcb-44d3-bb15-79ac2af3f622): created successfully Jun 30 16:11:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebda40fd-acff-429b-9c0b-5f1d60c07d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Flow 'volume_create_manager' (ec0a64d9-cc30-4543-949b-c22b22347840) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:11:51 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-88b8d9f8-9591-45ed-a9bb-accfc8a43632 tempest-VolumesTransfersV355Test-891374347 None] Created volume successfully. Jun 30 16:11:53 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c9ccade9-e183-4260-a759-56d1f12feef7 tempest-VolumesTransfersV355Test-1643515293 None] Acquiring lock "cinder-29bcf2a6-0dcb-44d3-bb15-79ac2af3f622-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:11:53 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c9ccade9-e183-4260-a759-56d1f12feef7 tempest-VolumesTransfersV355Test-1643515293 None] Lock "cinder-29bcf2a6-0dcb-44d3-bb15-79ac2af3f622-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:11:53 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c9ccade9-e183-4260-a759-56d1f12feef7 tempest-VolumesTransfersV355Test-1643515293 None] Acquiring lock "cinder-quobyte-29bcf2a6-0dcb-44d3-bb15-79ac2af3f622" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:11:53 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c9ccade9-e183-4260-a759-56d1f12feef7 tempest-VolumesTransfersV355Test-1643515293 None] Lock "cinder-quobyte-29bcf2a6-0dcb-44d3-bb15-79ac2af3f622" acquired by "delete_volume" :: waited 0.019s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:11:53 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[76492675-45b6-432d-b036-bb4b90d40469]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:11:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c9ccade9-e183-4260-a759-56d1f12feef7 tempest-VolumesTransfersV355Test-1643515293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29bcf2a6-0dcb-44d3-bb15-79ac2af3f622 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:53 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29bcf2a6-0dcb-44d3-bb15-79ac2af3f622 Jun 30 16:11:53 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:54 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c9ccade9-e183-4260-a759-56d1f12feef7 tempest-VolumesTransfersV355Test-1643515293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29bcf2a6-0dcb-44d3-bb15-79ac2af3f622" returned: 0 in 1.000s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c9ccade9-e183-4260-a759-56d1f12feef7 tempest-VolumesTransfersV355Test-1643515293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29bcf2a6-0dcb-44d3-bb15-79ac2af3f622 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:54 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29bcf2a6-0dcb-44d3-bb15-79ac2af3f622 Jun 30 16:11:54 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Flow 'volume_create_manager' (8e4967ca-3cbb-4547-a359-c1a3ca3c00bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e3485e-1b05-4c59-a617-bce9b19cb5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e3485e-1b05-4c59-a617-bce9b19cb5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1477581392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6db9d99-c026-4407-b8fd-e54657bb3c87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c9dca1924d0497dbba03b57e5dcd6de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:11:54Z,use_quota=True,user_id='f1944abe225c4ecc963b533bdbec0a3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ace8abf-0f72-4378-a425-38fcb088ab73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ace8abf-0f72-4378-a425-38fcb088ab73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918f9933-e97a-4047-9a50-6e4a949d4428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918f9933-e97a-4047-9a50-6e4a949d4428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6db9d99-c026-4407-b8fd-e54657bb3c87', 'volume_name': 'volume-f6db9d99-c026-4407-b8fd-e54657bb3c87', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ebcbc5a-d821-4be5-a672-9e609152d871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ebcbc5a-d821-4be5-a672-9e609152d871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba958fad-777c-425b-8e66-5be7dde745ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:54 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Volume f6db9d99-c026-4407-b8fd-e54657bb3c87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6db9d99-c026-4407-b8fd-e54657bb3c87', 'volume_size': 1} Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1477581392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6db9d99-c026-4407-b8fd-e54657bb3c87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c9dca1924d0497dbba03b57e5dcd6de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:11:54Z,use_quota=True,user_id='f1944abe225c4ecc963b533bdbec0a3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Creating volume f6db9d99-c026-4407-b8fd-e54657bb3c87 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:11:54 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:54 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87 1073741824 Jun 30 16:11:54 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:54 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c9ccade9-e183-4260-a759-56d1f12feef7 tempest-VolumesTransfersV355Test-1643515293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29bcf2a6-0dcb-44d3-bb15-79ac2af3f622" returned: 0 in 0.792s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:55 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c9ccade9-e183-4260-a759-56d1f12feef7 tempest-VolumesTransfersV355Test-1643515293 None] Lock "cinder-quobyte-29bcf2a6-0dcb-44d3-bb15-79ac2af3f622" released by "delete_volume" :: held 1.869s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:11:55 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-c9ccade9-e183-4260-a759-56d1f12feef7 tempest-VolumesTransfersV355Test-1643515293 None] Created reservations ['4d865fb8-7798-4852-89e2-4ddd50c586a6', '311275b7-c2a1-474c-a447-baf47e2112b9', '3e2ed43f-1b6f-4a3e-ae23-5fb57fccbffe', '8708066b-0897-42b1-acf3-5418b2b19b86'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:11:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c9ccade9-e183-4260-a759-56d1f12feef7 tempest-VolumesTransfersV355Test-1643515293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:11:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c9ccade9-e183-4260-a759-56d1f12feef7 tempest-VolumesTransfersV355Test-1643515293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:11:55 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c9ccade9-e183-4260-a759-56d1f12feef7 tempest-VolumesTransfersV355Test-1643515293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:11:55 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c9ccade9-e183-4260-a759-56d1f12feef7 tempest-VolumesTransfersV355Test-1643515293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:11:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c9ccade9-e183-4260-a759-56d1f12feef7 tempest-VolumesTransfersV355Test-1643515293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:11:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c9ccade9-e183-4260-a759-56d1f12feef7 tempest-VolumesTransfersV355Test-1643515293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:55 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:11:55 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:55 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87 1073741824" returned: 0 in 1.065s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:55 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87 Jun 30 16:11:55 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:55 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c9ccade9-e183-4260-a759-56d1f12feef7 tempest-VolumesTransfersV355Test-1643515293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.736s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:55 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-c9ccade9-e183-4260-a759-56d1f12feef7 tempest-VolumesTransfersV355Test-1643515293 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:11:55 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-c9ccade9-e183-4260-a759-56d1f12feef7 tempest-VolumesTransfersV355Test-1643515293 None] Deleted volume successfully. Jun 30 16:11:55 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c9ccade9-e183-4260-a759-56d1f12feef7 tempest-VolumesTransfersV355Test-1643515293 None] Lock "cinder-29bcf2a6-0dcb-44d3-bb15-79ac2af3f622-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:11:56 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87" returned: 0 in 0.760s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:56 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:11:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:11:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba958fad-777c-425b-8e66-5be7dde745ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6db9d99-c026-4407-b8fd-e54657bb3c87', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c09825-498e-43e3-8516-92cfaca34ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:11:56 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Volume volume-f6db9d99-c026-4407-b8fd-e54657bb3c87 (f6db9d99-c026-4407-b8fd-e54657bb3c87): created successfully Jun 30 16:11:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c09825-498e-43e3-8516-92cfaca34ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:11:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Flow 'volume_create_manager' (8e4967ca-3cbb-4547-a359-c1a3ca3c00bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:11:56 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-7cbdbcda-baab-4c8e-8747-777846449ce2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Created volume successfully. Jun 30 16:11:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b3de92fa-ec2d-4713-925b-543402069638 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:11:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b3de92fa-ec2d-4713-925b-543402069638 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:11:57 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-b3de92fa-ec2d-4713-925b-543402069638 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Creating offline snapshot 738771a0-79e6-4526-9d7a-50bd70186964 of volume f6db9d99-c026-4407-b8fd-e54657bb3c87 {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:11:57 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a6afac-7cdb-45e9-9726-a0ecab98bc3d]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:11:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b3de92fa-ec2d-4713-925b-543402069638 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:58 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87 Jun 30 16:11:58 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:59 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b3de92fa-ec2d-4713-925b-543402069638 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87" returned: 0 in 1.050s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b3de92fa-ec2d-4713-925b-543402069638 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.738771a0-79e6-4526-9d7a-50bd70186964 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:59 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.738771a0-79e6-4526-9d7a-50bd70186964 1G Jun 30 16:11:59 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:11:59 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Jun 30 16:11:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b3de92fa-ec2d-4713-925b-543402069638 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.738771a0-79e6-4526-9d7a-50bd70186964 1G" returned: 0 in 0.884s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:11:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b3de92fa-ec2d-4713-925b-543402069638 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6db9d99-c026-4407-b8fd-e54657bb3c87 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.738771a0-79e6-4526-9d7a-50bd70186964 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:11:59 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6db9d99-c026-4407-b8fd-e54657bb3c87 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.738771a0-79e6-4526-9d7a-50bd70186964 Jun 30 16:11:59 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:00 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b3de92fa-ec2d-4713-925b-543402069638 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6db9d99-c026-4407-b8fd-e54657bb3c87 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.738771a0-79e6-4526-9d7a-50bd70186964" returned: 0 in 0.886s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:00 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-b3de92fa-ec2d-4713-925b-543402069638 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.738771a0-79e6-4526-9d7a-50bd70186964 is being set with open permissions: ugo+rw Jun 30 16:12:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b3de92fa-ec2d-4713-925b-543402069638 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.738771a0-79e6-4526-9d7a-50bd70186964 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:00 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.738771a0-79e6-4526-9d7a-50bd70186964 Jun 30 16:12:00 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:01 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b3de92fa-ec2d-4713-925b-543402069638 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.738771a0-79e6-4526-9d7a-50bd70186964" returned: 0 in 0.828s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b3de92fa-ec2d-4713-925b-543402069638 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:01 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.info Jun 30 16:12:01 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:02 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b3de92fa-ec2d-4713-925b-543402069638 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.info" returned: 0 in 1.012s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:02 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-b3de92fa-ec2d-4713-925b-543402069638 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.info is being set with open permissions: ugo+rw Jun 30 16:12:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b3de92fa-ec2d-4713-925b-543402069638 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:02 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.info Jun 30 16:12:02 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:02 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:12:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Flow 'volume_create_manager' (08af5e97-1f10-4ef6-b768-c410e02b6239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:12:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cb09385-f261-4b40-a696-6c9cb581e347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cb09385-f261-4b40-a696-6c9cb581e347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-175790579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d931b38e-6c54-4e53-9599-e536fdfcfa1e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e93140b29bfa4128a916707519452858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:12:03Z,use_quota=True,user_id='4edf3c3fc05d48fa8e44ae9f2327f8c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98cdb1c1-63a8-44d2-9eeb-24f06bdaecc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98cdb1c1-63a8-44d2-9eeb-24f06bdaecc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44ac33c-19cc-42ab-8380-4fefcb4a2d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44ac33c-19cc-42ab-8380-4fefcb4a2d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd931b38e-6c54-4e53-9599-e536fdfcfa1e', 'volume_name': 'volume-d931b38e-6c54-4e53-9599-e536fdfcfa1e', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a9c4c0-8c1f-47db-86fc-dca74240f830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a9c4c0-8c1f-47db-86fc-dca74240f830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b21cf70-2cc9-4aeb-8527-4b90b053d047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:02 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Volume d931b38e-6c54-4e53-9599-e536fdfcfa1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d931b38e-6c54-4e53-9599-e536fdfcfa1e', 'volume_size': 1} Jun 30 16:12:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:12:03 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b3de92fa-ec2d-4713-925b-543402069638 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.info" returned: 0 in 0.713s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b3de92fa-ec2d-4713-925b-543402069638 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.500s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:12:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.614s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:12:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-175790579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d931b38e-6c54-4e53-9599-e536fdfcfa1e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e93140b29bfa4128a916707519452858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:12:03Z,use_quota=True,user_id='4edf3c3fc05d48fa8e44ae9f2327f8c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:12:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Creating volume d931b38e-6c54-4e53-9599-e536fdfcfa1e {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:12:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:12:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:12:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:12:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:12:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:12:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:12:03 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:12:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d931b38e-6c54-4e53-9599-e536fdfcfa1e 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:03 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d931b38e-6c54-4e53-9599-e536fdfcfa1e 1073741824 Jun 30 16:12:03 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:03 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-b3de92fa-ec2d-4713-925b-543402069638 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Create snapshot completed successfully Jun 30 16:12:04 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d931b38e-6c54-4e53-9599-e536fdfcfa1e 1073741824" returned: 0 in 0.918s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:04 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:DELETE=6,cinder:UPDATE=72,cinder:SELECT=42,cinder:INSERT=12 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:12:04 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=57,cinder:INSERT=20,cinder:UPDATE=69,cinder:DELETE=9 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:12:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d931b38e-6c54-4e53-9599-e536fdfcfa1e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:04 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d931b38e-6c54-4e53-9599-e536fdfcfa1e Jun 30 16:12:04 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-61ee6636-54d7-477d-ac61-1b83784e39ee tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Acquiring lock "cinder-738771a0-79e6-4526-9d7a-50bd70186964-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:12:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-61ee6636-54d7-477d-ac61-1b83784e39ee tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Lock "cinder-738771a0-79e6-4526-9d7a-50bd70186964-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:12:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-61ee6636-54d7-477d-ac61-1b83784e39ee tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Acquiring lock "cinder-quobyte-f6db9d99-c026-4407-b8fd-e54657bb3c87" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:12:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-61ee6636-54d7-477d-ac61-1b83784e39ee tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Lock "cinder-quobyte-f6db9d99-c026-4407-b8fd-e54657bb3c87" acquired by "delete_snapshot" :: waited 0.124s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:12:05 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-61ee6636-54d7-477d-ac61-1b83784e39ee tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Acquiring lock "cinder-quobyte-738771a0-79e6-4526-9d7a-50bd70186964" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:12:05 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-61ee6636-54d7-477d-ac61-1b83784e39ee tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Lock "cinder-quobyte-738771a0-79e6-4526-9d7a-50bd70186964" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:12:05 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-61ee6636-54d7-477d-ac61-1b83784e39ee tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Deleting offline snapshot 738771a0-79e6-4526-9d7a-50bd70186964 of volume f6db9d99-c026-4407-b8fd-e54657bb3c87 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:12:05 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-61ee6636-54d7-477d-ac61-1b83784e39ee tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] snapshot_file for this snap is: volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.738771a0-79e6-4526-9d7a-50bd70186964 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:12:05 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dab0d60-8108-43f2-89ab-d82e8a32e88a]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:12:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-61ee6636-54d7-477d-ac61-1b83784e39ee tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.738771a0-79e6-4526-9d7a-50bd70186964 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:05 devstack sudo[101959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.738771a0-79e6-4526-9d7a-50bd70186964 Jun 30 16:12:05 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:05 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d931b38e-6c54-4e53-9599-e536fdfcfa1e" returned: 0 in 1.266s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:05 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] <== create_volume: return (2281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:12:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.284s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:12:05 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b21cf70-2cc9-4aeb-8527-4b90b053d047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d931b38e-6c54-4e53-9599-e536fdfcfa1e', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:05 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4fa22e9-ffbf-4c78-b228-14d35ff6bbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:05 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Volume volume-d931b38e-6c54-4e53-9599-e536fdfcfa1e (d931b38e-6c54-4e53-9599-e536fdfcfa1e): created successfully Jun 30 16:12:05 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4fa22e9-ffbf-4c78-b228-14d35ff6bbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:05 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Flow 'volume_create_manager' (08af5e97-1f10-4ef6-b768-c410e02b6239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:12:06 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-a0aef737-8e48-4762-a1e2-6d34b99f842b tempest-VolumesGetTest-109886290 None] Created volume successfully. Jun 30 16:12:06 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-61ee6636-54d7-477d-ac61-1b83784e39ee tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.738771a0-79e6-4526-9d7a-50bd70186964" returned: 0 in 1.691s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-61ee6636-54d7-477d-ac61-1b83784e39ee tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6db9d99-c026-4407-b8fd-e54657bb3c87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:12:06 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebd26bd-91b5-4ca1-ad46-33ff5a5bce80]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:12:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-61ee6636-54d7-477d-ac61-1b83784e39ee tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:07 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87 Jun 30 16:12:07 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:08 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-61ee6636-54d7-477d-ac61-1b83784e39ee tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87" returned: 0 in 1.543s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-61ee6636-54d7-477d-ac61-1b83784e39ee tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.738771a0-79e6-4526-9d7a-50bd70186964 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:08 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.738771a0-79e6-4526-9d7a-50bd70186964 Jun 30 16:12:08 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Flow 'volume_create_manager' (505cd190-1267-4d5b-92e4-980045b66b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e134fb33-a759-4301-aa73-40550a2be5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e134fb33-a759-4301-aa73-40550a2be5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:12:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-298596340',display_name='tempest-VolumesGetTest-Volume-164597938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7effde67-4f11-449e-8e2b-7c158a0c3efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93140b29bfa4128a916707519452858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:12:09Z,use_quota=True,user_id='4edf3c3fc05d48fa8e44ae9f2327f8c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16405202-afd7-42f3-a407-71e71e9d2650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16405202-afd7-42f3-a407-71e71e9d2650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44871b6e-f6c1-40fd-a8cb-27b52491201b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44871b6e-f6c1-40fd-a8cb-27b52491201b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7effde67-4f11-449e-8e2b-7c158a0c3efc', 'volume_name': 'volume-7effde67-4f11-449e-8e2b-7c158a0c3efc', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ab9415-6071-4ee8-86a8-f73e578f6857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ab9415-6071-4ee8-86a8-f73e578f6857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1232007f-734b-4f50-8f6d-00907b7bfb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:08 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Volume 7effde67-4f11-449e-8e2b-7c158a0c3efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7effde67-4f11-449e-8e2b-7c158a0c3efc', 'volume_size': 1} Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:12:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-298596340',display_name='tempest-VolumesGetTest-Volume-164597938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7effde67-4f11-449e-8e2b-7c158a0c3efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93140b29bfa4128a916707519452858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:12:09Z,use_quota=True,user_id='4edf3c3fc05d48fa8e44ae9f2327f8c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Creating volume 7effde67-4f11-449e-8e2b-7c158a0c3efc {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:12:08 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:12:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7effde67-4f11-449e-8e2b-7c158a0c3efc 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:08 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7effde67-4f11-449e-8e2b-7c158a0c3efc 1073741824 Jun 30 16:12:08 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:10 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-61ee6636-54d7-477d-ac61-1b83784e39ee tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.738771a0-79e6-4526-9d7a-50bd70186964" returned: 0 in 1.732s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-61ee6636-54d7-477d-ac61-1b83784e39ee tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.738771a0-79e6-4526-9d7a-50bd70186964 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:10 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.738771a0-79e6-4526-9d7a-50bd70186964 Jun 30 16:12:10 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:10 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7effde67-4f11-449e-8e2b-7c158a0c3efc 1073741824" returned: 0 in 1.577s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7effde67-4f11-449e-8e2b-7c158a0c3efc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:10 devstack sudo[102077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7effde67-4f11-449e-8e2b-7c158a0c3efc Jun 30 16:12:10 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:11 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-61ee6636-54d7-477d-ac61-1b83784e39ee tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87.738771a0-79e6-4526-9d7a-50bd70186964" returned: 0 in 0.980s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:11 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-61ee6636-54d7-477d-ac61-1b83784e39ee tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Lock "cinder-quobyte-738771a0-79e6-4526-9d7a-50bd70186964" released by "_delete_snapshot" :: held 6.144s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:12:11 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-61ee6636-54d7-477d-ac61-1b83784e39ee tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Lock "cinder-quobyte-f6db9d99-c026-4407-b8fd-e54657bb3c87" released by "delete_snapshot" :: held 6.209s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:12:11 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-61ee6636-54d7-477d-ac61-1b83784e39ee tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Created reservations ['117e0f0c-f4db-4b7d-8e54-34f686499ca0', 'f7b1b9ab-68a1-40ae-8ab8-9286c9f90aa5', '65efa825-32ea-4666-bf16-24c61f60e00e', '0d21c909-ac0b-4286-9610-e91d1ab477c7'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:12:11 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-61ee6636-54d7-477d-ac61-1b83784e39ee tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Delete snapshot completed successfully. Jun 30 16:12:11 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-61ee6636-54d7-477d-ac61-1b83784e39ee tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Lock "cinder-738771a0-79e6-4526-9d7a-50bd70186964-delete_snapshot" released by "delete_snapshot" :: held 6.611s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:12:11 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7effde67-4f11-449e-8e2b-7c158a0c3efc" returned: 0 in 1.061s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:11 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] <== create_volume: return (2708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:12:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.711s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:12:11 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1232007f-734b-4f50-8f6d-00907b7bfb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7effde67-4f11-449e-8e2b-7c158a0c3efc', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:11 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9633b1-bc8e-42b9-bba4-f43bf2fc78eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:11 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Volume volume-7effde67-4f11-449e-8e2b-7c158a0c3efc (7effde67-4f11-449e-8e2b-7c158a0c3efc): created successfully Jun 30 16:12:11 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9633b1-bc8e-42b9-bba4-f43bf2fc78eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:11 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Flow 'volume_create_manager' (505cd190-1267-4d5b-92e4-980045b66b79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:12:11 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-cb70779e-d778-4fcd-89ab-e85dd66d2b71 tempest-VolumesGetTest-109886290 None] Created volume successfully. Jun 30 16:12:11 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9de40872-dc56-44e0-8e8a-06cb151fc20d tempest-VolumesGetTest-109886290 None] Acquiring lock "cinder-7effde67-4f11-449e-8e2b-7c158a0c3efc-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:12:11 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9de40872-dc56-44e0-8e8a-06cb151fc20d tempest-VolumesGetTest-109886290 None] Lock "cinder-7effde67-4f11-449e-8e2b-7c158a0c3efc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:12:11 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9de40872-dc56-44e0-8e8a-06cb151fc20d tempest-VolumesGetTest-109886290 None] Acquiring lock "cinder-quobyte-7effde67-4f11-449e-8e2b-7c158a0c3efc" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:12:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9de40872-dc56-44e0-8e8a-06cb151fc20d tempest-VolumesGetTest-109886290 None] Lock "cinder-quobyte-7effde67-4f11-449e-8e2b-7c158a0c3efc" acquired by "delete_volume" :: waited 0.016s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:12:12 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edca9b5-e3bb-4317-99bb-fb1744965fdb]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:12:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9de40872-dc56-44e0-8e8a-06cb151fc20d tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7effde67-4f11-449e-8e2b-7c158a0c3efc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:12 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7effde67-4f11-449e-8e2b-7c158a0c3efc Jun 30 16:12:12 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-593e2633-9cce-47f7-b0b2-05aa6c6a9f87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Acquiring lock "cinder-f6db9d99-c026-4407-b8fd-e54657bb3c87-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:12:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-593e2633-9cce-47f7-b0b2-05aa6c6a9f87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Lock "cinder-f6db9d99-c026-4407-b8fd-e54657bb3c87-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:12:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-593e2633-9cce-47f7-b0b2-05aa6c6a9f87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Acquiring lock "cinder-quobyte-f6db9d99-c026-4407-b8fd-e54657bb3c87" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:12:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-593e2633-9cce-47f7-b0b2-05aa6c6a9f87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Lock "cinder-quobyte-f6db9d99-c026-4407-b8fd-e54657bb3c87" acquired by "delete_volume" :: waited 0.040s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:12:12 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[c868d6a2-8ac1-453a-93e5-b50a07226b04]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:12:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-593e2633-9cce-47f7-b0b2-05aa6c6a9f87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:13 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87 Jun 30 16:12:13 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:13 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9de40872-dc56-44e0-8e8a-06cb151fc20d tempest-VolumesGetTest-109886290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7effde67-4f11-449e-8e2b-7c158a0c3efc" returned: 0 in 1.146s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9de40872-dc56-44e0-8e8a-06cb151fc20d tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7effde67-4f11-449e-8e2b-7c158a0c3efc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:13 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7effde67-4f11-449e-8e2b-7c158a0c3efc Jun 30 16:12:13 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:13 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-593e2633-9cce-47f7-b0b2-05aa6c6a9f87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87" returned: 0 in 1.067s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-593e2633-9cce-47f7-b0b2-05aa6c6a9f87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:13 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87 Jun 30 16:12:13 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:14 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9de40872-dc56-44e0-8e8a-06cb151fc20d tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7effde67-4f11-449e-8e2b-7c158a0c3efc" returned: 0 in 0.850s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:14 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9de40872-dc56-44e0-8e8a-06cb151fc20d tempest-VolumesGetTest-109886290 None] Lock "cinder-quobyte-7effde67-4f11-449e-8e2b-7c158a0c3efc" released by "delete_volume" :: held 2.052s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:12:14 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-9de40872-dc56-44e0-8e8a-06cb151fc20d tempest-VolumesGetTest-109886290 None] Created reservations ['5e351e08-9fba-4c46-b565-48a3bba4006c', '54efe6e8-5a86-4abd-8839-15dca1675bbe', '2504ed0f-b141-48cb-8e16-b11a8a94fced', 'f968aa81-ff3c-4b5b-b395-387c881a2e4f'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:12:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9de40872-dc56-44e0-8e8a-06cb151fc20d tempest-VolumesGetTest-109886290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:12:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9de40872-dc56-44e0-8e8a-06cb151fc20d tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:12:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9de40872-dc56-44e0-8e8a-06cb151fc20d tempest-VolumesGetTest-109886290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:12:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9de40872-dc56-44e0-8e8a-06cb151fc20d tempest-VolumesGetTest-109886290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:12:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9de40872-dc56-44e0-8e8a-06cb151fc20d tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:12:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9de40872-dc56-44e0-8e8a-06cb151fc20d tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:14 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:12:14 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:14 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4c955499-cac2-4fc1-8976-92ecf36d678c tempest-VolumesGetTest-109886290 None] Acquiring lock "cinder-d931b38e-6c54-4e53-9599-e536fdfcfa1e-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:12:14 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4c955499-cac2-4fc1-8976-92ecf36d678c tempest-VolumesGetTest-109886290 None] Lock "cinder-d931b38e-6c54-4e53-9599-e536fdfcfa1e-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:12:14 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4c955499-cac2-4fc1-8976-92ecf36d678c tempest-VolumesGetTest-109886290 None] Acquiring lock "cinder-quobyte-d931b38e-6c54-4e53-9599-e536fdfcfa1e" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:12:14 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4c955499-cac2-4fc1-8976-92ecf36d678c tempest-VolumesGetTest-109886290 None] Lock "cinder-quobyte-d931b38e-6c54-4e53-9599-e536fdfcfa1e" acquired by "delete_volume" :: waited 0.041s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:12:14 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc33480-91f5-448e-93f6-2cc1bcdee822]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:12:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4c955499-cac2-4fc1-8976-92ecf36d678c tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d931b38e-6c54-4e53-9599-e536fdfcfa1e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:15 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d931b38e-6c54-4e53-9599-e536fdfcfa1e Jun 30 16:12:15 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:15 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-593e2633-9cce-47f7-b0b2-05aa6c6a9f87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6db9d99-c026-4407-b8fd-e54657bb3c87" returned: 0 in 1.551s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:15 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9de40872-dc56-44e0-8e8a-06cb151fc20d tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.241s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:15 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-9de40872-dc56-44e0-8e8a-06cb151fc20d tempest-VolumesGetTest-109886290 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:12:15 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-593e2633-9cce-47f7-b0b2-05aa6c6a9f87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Lock "cinder-quobyte-f6db9d99-c026-4407-b8fd-e54657bb3c87" released by "delete_volume" :: held 2.754s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:12:15 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-9de40872-dc56-44e0-8e8a-06cb151fc20d tempest-VolumesGetTest-109886290 None] Deleted volume successfully. Jun 30 16:12:15 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9de40872-dc56-44e0-8e8a-06cb151fc20d tempest-VolumesGetTest-109886290 None] Lock "cinder-7effde67-4f11-449e-8e2b-7c158a0c3efc-delete_volume" released by "delete_volume" :: held 3.577s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:12:15 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-593e2633-9cce-47f7-b0b2-05aa6c6a9f87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Created reservations ['e4ebf409-44f2-4d62-9707-69edf1c62528', 'be952262-b33b-4caf-95bb-5b9ea258755d', '7834decd-a760-463e-a114-539e80a9c4f6', '361f61e5-ad8d-45e1-aad9-0fa3f66c762c'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:12:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-593e2633-9cce-47f7-b0b2-05aa6c6a9f87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:12:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-593e2633-9cce-47f7-b0b2-05aa6c6a9f87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:12:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-593e2633-9cce-47f7-b0b2-05aa6c6a9f87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:12:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-593e2633-9cce-47f7-b0b2-05aa6c6a9f87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:12:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-593e2633-9cce-47f7-b0b2-05aa6c6a9f87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:12:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-593e2633-9cce-47f7-b0b2-05aa6c6a9f87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:15 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:12:15 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:16 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4c955499-cac2-4fc1-8976-92ecf36d678c tempest-VolumesGetTest-109886290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d931b38e-6c54-4e53-9599-e536fdfcfa1e" returned: 0 in 1.169s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4c955499-cac2-4fc1-8976-92ecf36d678c tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d931b38e-6c54-4e53-9599-e536fdfcfa1e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:16 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d931b38e-6c54-4e53-9599-e536fdfcfa1e Jun 30 16:12:16 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:16 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-593e2633-9cce-47f7-b0b2-05aa6c6a9f87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.211s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:16 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-593e2633-9cce-47f7-b0b2-05aa6c6a9f87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:12:16 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-593e2633-9cce-47f7-b0b2-05aa6c6a9f87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Deleted volume successfully. Jun 30 16:12:17 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-593e2633-9cce-47f7-b0b2-05aa6c6a9f87 tempest-VolumeSnapshotQuotasNegativeTestJSON-1769321548 None] Lock "cinder-f6db9d99-c026-4407-b8fd-e54657bb3c87-delete_volume" released by "delete_volume" :: held 4.424s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:12:17 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4c955499-cac2-4fc1-8976-92ecf36d678c tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d931b38e-6c54-4e53-9599-e536fdfcfa1e" returned: 0 in 1.083s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:17 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4c955499-cac2-4fc1-8976-92ecf36d678c tempest-VolumesGetTest-109886290 None] Lock "cinder-quobyte-d931b38e-6c54-4e53-9599-e536fdfcfa1e" released by "delete_volume" :: held 2.344s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:12:17 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-4c955499-cac2-4fc1-8976-92ecf36d678c tempest-VolumesGetTest-109886290 None] Created reservations ['de92af27-8343-4209-937d-a4170031c049', 'f684923d-0caa-46ea-8248-29b3931291a6', 'f9fb86be-4ecf-4d62-bb36-753c4677a409', '0556aaa4-0797-4cd5-9a50-e0fe6fea8c43'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:12:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4c955499-cac2-4fc1-8976-92ecf36d678c tempest-VolumesGetTest-109886290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:12:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4c955499-cac2-4fc1-8976-92ecf36d678c tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:12:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-4c955499-cac2-4fc1-8976-92ecf36d678c tempest-VolumesGetTest-109886290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:12:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-4c955499-cac2-4fc1-8976-92ecf36d678c tempest-VolumesGetTest-109886290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:12:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4c955499-cac2-4fc1-8976-92ecf36d678c tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:12:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4c955499-cac2-4fc1-8976-92ecf36d678c tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:17 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:12:17 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:18 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4c955499-cac2-4fc1-8976-92ecf36d678c tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.098s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:18 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-4c955499-cac2-4fc1-8976-92ecf36d678c tempest-VolumesGetTest-109886290 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:12:18 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-4c955499-cac2-4fc1-8976-92ecf36d678c tempest-VolumesGetTest-109886290 None] Deleted volume successfully. Jun 30 16:12:18 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4c955499-cac2-4fc1-8976-92ecf36d678c tempest-VolumesGetTest-109886290 None] Lock "cinder-d931b38e-6c54-4e53-9599-e536fdfcfa1e-delete_volume" released by "delete_volume" :: held 3.882s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:12:19 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:12:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Flow 'volume_create_manager' (30cb3aa6-9d00-4e76-83c2-11d42a1b3dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:12:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e2dc52-580e-434c-aee8-8db361a4b9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e2dc52-580e-434c-aee8-8db361a4b9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1337575927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165b9c47-b6db-48ed-b911-ca57e37512cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93140b29bfa4128a916707519452858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:12:19Z,use_quota=True,user_id='4edf3c3fc05d48fa8e44ae9f2327f8c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1670d2-bb5b-44a5-8b47-4a1e87b7d6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1670d2-bb5b-44a5-8b47-4a1e87b7d6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ffce0df-cf99-4e0d-b0cd-fd25e6247e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ffce0df-cf99-4e0d-b0cd-fd25e6247e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '165b9c47-b6db-48ed-b911-ca57e37512cd', 'volume_name': 'volume-165b9c47-b6db-48ed-b911-ca57e37512cd', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9abcc9-8047-4319-8780-e33a7f72af13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9abcc9-8047-4319-8780-e33a7f72af13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51dd635e-2025-48f3-b127-a342c3f57cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:19 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Volume 165b9c47-b6db-48ed-b911-ca57e37512cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-165b9c47-b6db-48ed-b911-ca57e37512cd', 'volume_size': 1} Jun 30 16:12:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:12:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:12:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1337575927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165b9c47-b6db-48ed-b911-ca57e37512cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93140b29bfa4128a916707519452858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:12:19Z,use_quota=True,user_id='4edf3c3fc05d48fa8e44ae9f2327f8c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:12:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Creating volume 165b9c47-b6db-48ed-b911-ca57e37512cd {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:12:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:12:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:12:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:12:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:12:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:12:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:12:19 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:12:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:19 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd 1073741824 Jun 30 16:12:19 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:20 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd 1073741824" returned: 0 in 1.318s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:20 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd Jun 30 16:12:20 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:21 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd" returned: 0 in 0.710s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] <== create_volume: return (2113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:12:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.117s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:12:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51dd635e-2025-48f3-b127-a342c3f57cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-165b9c47-b6db-48ed-b911-ca57e37512cd', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b095278a-3bf4-4f17-82fc-92120dc25423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:21 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Volume volume-165b9c47-b6db-48ed-b911-ca57e37512cd (165b9c47-b6db-48ed-b911-ca57e37512cd): created successfully Jun 30 16:12:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b095278a-3bf4-4f17-82fc-92120dc25423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Flow 'volume_create_manager' (30cb3aa6-9d00-4e76-83c2-11d42a1b3dbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:12:21 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-de43a46d-e91c-4762-b4fd-3a5ae86a0f5b tempest-VolumesGetTest-109886290 None] Created volume successfully. Jun 30 16:12:22 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:12:22 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Flow 'volume_create_manager' (b5f8a9ce-6479-4380-838b-1eb935d5f1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:12:22 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975cea7c-0bee-4399-8301-a2c22a084bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975cea7c-0bee-4399-8301-a2c22a084bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1665434366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe20319c-14b4-44d4-a560-93ac7760c0a4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e93140b29bfa4128a916707519452858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=165b9c47-b6db-48ed-b911-ca57e37512cd,status='creating',terminated_at=None,updated_at=2026-06-30T14:12:23Z,use_quota=True,user_id='4edf3c3fc05d48fa8e44ae9f2327f8c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030c6a77-6090-402a-8ead-22387d9a6034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030c6a77-6090-402a-8ead-22387d9a6034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0168197-95f5-46f7-bf83-4b1c00c71279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0168197-95f5-46f7-bf83-4b1c00c71279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fe20319c-14b4-44d4-a560-93ac7760c0a4', 'volume_name': 'volume-fe20319c-14b4-44d4-a560-93ac7760c0a4', 'volume_size': 1, 'source_volid': '165b9c47-b6db-48ed-b911-ca57e37512cd', 'source_volstatus': 'available'}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d24ca8-778f-4740-b9b1-9b28f3dec84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d24ca8-778f-4740-b9b1-9b28f3dec84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44220d4-5ac4-475e-a84f-8d964924855a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:23 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Volume fe20319c-14b4-44d4-a560-93ac7760c0a4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fe20319c-14b4-44d4-a560-93ac7760c0a4', 'volume_size': 1, 'source_volid': '165b9c47-b6db-48ed-b911-ca57e37512cd', 'source_volstatus': 'available'} Jun 30 16:12:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:12:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:12:23 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Cloning volume 165b9c47-b6db-48ed-b911-ca57e37512cd to volume fe20319c-14b4-44d4-a560-93ac7760c0a4 Jun 30 16:12:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Creating offline snapshot 1e051ca3-9cbf-4a4d-947e-3a21686ba930 of volume 165b9c47-b6db-48ed-b911-ca57e37512cd {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:12:23 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[05aa7f04-57e5-48e3-a5da-fe2adbbf30b2]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:12:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:23 devstack sudo[102150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd Jun 30 16:12:23 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:23 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd" returned: 0 in 0.839s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.1e051ca3-9cbf-4a4d-947e-3a21686ba930 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:24 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.1e051ca3-9cbf-4a4d-947e-3a21686ba930 1G Jun 30 16:12:24 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:25 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.1e051ca3-9cbf-4a4d-947e-3a21686ba930 1G" returned: 0 in 1.078s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-165b9c47-b6db-48ed-b911-ca57e37512cd -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.1e051ca3-9cbf-4a4d-947e-3a21686ba930 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:25 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-165b9c47-b6db-48ed-b911-ca57e37512cd -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.1e051ca3-9cbf-4a4d-947e-3a21686ba930 Jun 30 16:12:25 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:25 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-165b9c47-b6db-48ed-b911-ca57e37512cd -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.1e051ca3-9cbf-4a4d-947e-3a21686ba930" returned: 0 in 0.815s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:25 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.1e051ca3-9cbf-4a4d-947e-3a21686ba930 is being set with open permissions: ugo+rw Jun 30 16:12:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.1e051ca3-9cbf-4a4d-947e-3a21686ba930 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:25 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.1e051ca3-9cbf-4a4d-947e-3a21686ba930 Jun 30 16:12:25 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:27 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.1e051ca3-9cbf-4a4d-947e-3a21686ba930" returned: 0 in 1.157s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:27 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:12:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Flow 'volume_create_manager' (89de752f-611c-4d6a-b0b7-cee03c96c255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:12:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743c6ff8-5c27-4686-9163-d0c4a8e75872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743c6ff8-5c27-4686-9163-d0c4a8e75872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2003200917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80bc3c5e-c67c-4531-bc11-702c5ed5cff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c9cf921a0b453fb116f792fcf8f47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:12:27Z,use_quota=True,user_id='32e984574d954d0a926927073189eafd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aed6174-49a8-4b9a-8228-de1928623ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aed6174-49a8-4b9a-8228-de1928623ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493b0866-bdcb-42b0-ac6f-8a7d08f9ebf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:27 devstack cinder-volume[93781]: DEBUG cinder.image.glance [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Creating Keystone auth plugin from conf {{(pid=93781) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 30 16:12:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:27 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.info Jun 30 16:12:27 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:28 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493b0866-bdcb-42b0-ac6f-8a7d08f9ebf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '80bc3c5e-c67c-4531-bc11-702c5ed5cff1', 'volume_name': 'volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1', 'volume_size': 1, 'image_id': '2303c773-75d0-4542-ba21-750c84d63b39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a85030669b0434f9a3a845e0c4388d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2303c773-75d0-4542-ba21-750c84d63b39', 'created_at': datetime.datetime(2026, 6, 30, 13, 59, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 13, 59, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2303c773-75d0-4542-ba21-750c84d63b39/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:28 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b956ef-655b-471b-833d-4212c8800666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:28 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b956ef-655b-471b-833d-4212c8800666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:28 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f96922-4530-4d22-b1a7-b66bf00553dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:28 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Volume 80bc3c5e-c67c-4531-bc11-702c5ed5cff1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1', 'volume_size': 1, 'image_id': '2303c773-75d0-4542-ba21-750c84d63b39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a85030669b0434f9a3a845e0c4388d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2303c773-75d0-4542-ba21-750c84d63b39', 'created_at': datetime.datetime(2026, 6, 30, 13, 59, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 13, 59, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2303c773-75d0-4542-ba21-750c84d63b39/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 30 16:12:28 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Trying to clone 80bc3c5e-c67c-4531-bc11-702c5ed5cff1 from image 2303c773-75d0-4542-ba21-750c84d63b39 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}]). {{(pid=93781) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 30 16:12:28 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.info" returned: 0 in 1.511s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:28 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.info is being set with open permissions: ugo+rw Jun 30 16:12:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:28 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.info Jun 30 16:12:28 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:28 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_f6g1h2w6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 30 16:12:28 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Image download 20.69 MB at 20.69 MB/s Jun 30 16:12:28 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[077cac19-59a1-41fe-9474-939294cc58ec]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:12:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_f6g1h2w6devstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:29 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_f6g1h2w6devstack@QuobyteHD Jun 30 16:12:29 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:29 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.info" returned: 0 in 0.965s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Acquiring lock "cinder-quobyte-fe20319c-14b4-44d4-a560-93ac7760c0a4" by "_copy_volume_from_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:12:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Lock "cinder-quobyte-fe20319c-14b4-44d4-a560-93ac7760c0a4" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:12:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] snapshot: 1e051ca3-9cbf-4a4d-947e-3a21686ba930, volume: fe20319c-14b4-44d4-a560-93ac7760c0a4, {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 30 16:12:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:12:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:12:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:12:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:12:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:12:29 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00f466f-a7f6-4921-98a8-9cbbdf7d050c]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:12:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.1e051ca3-9cbf-4a4d-947e-3a21686ba930 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:29 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.1e051ca3-9cbf-4a4d-947e-3a21686ba930 Jun 30 16:12:29 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:29 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_f6g1h2w6devstack@QuobyteHD" returned: 0 in 0.970s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:29 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Temporary image 2303c773-75d0-4542-ba21-750c84d63b39 is fetched for user 32e984574d954d0a926927073189eafd. {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 30 16:12:30 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8427223-38dd-4e71-8eff-f52d707fdc03]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:12:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_f6g1h2w6devstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:30 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_f6g1h2w6devstack@QuobyteHD Jun 30 16:12:30 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:30 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.1e051ca3-9cbf-4a4d-947e-3a21686ba930" returned: 0 in 0.962s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-165b9c47-b6db-48ed-b911-ca57e37512cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:12:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] will copy from snapshot at /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 30 16:12:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Creating direct copy from snapshot {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 30 16:12:30 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ac7e5b-7757-4b6d-8e2c-eafbc81e7423]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:12:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:30 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd Jun 30 16:12:30 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:30 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_f6g1h2w6devstack@QuobyteHD" returned: 0 in 0.869s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:12:31 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd" returned: 0 in 0.951s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:31 devstack cinder-volume[93781]: DEBUG cinder.utils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Path /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fe20319c-14b4-44d4-a560-93ac7760c0a4 not found in is_blk_device check {{(pid=93781) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 30 16:12:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fe20319c-14b4-44d4-a560-93ac7760c0a4 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:31 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fe20319c-14b4-44d4-a560-93ac7760c0a4 Jun 30 16:12:31 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:31 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:12:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Flow 'volume_create_manager' (7987ede9-bbf3-46cc-be65-06f8f47543fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:12:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a67897-f066-4419-a95f-02298963b2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a67897-f066-4419-a95f-02298963b2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1106105028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b028e64314c04b4c9e91bce8353f2570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:12:32Z,use_quota=True,user_id='f524b50a50ba4120b490ab57be3f8b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d9896ad-bb57-4c2b-8ca5-73f5a5d05921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d9896ad-bb57-4c2b-8ca5-73f5a5d05921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcdf0c1-cb65-4127-9881-2ab4f271ad01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcdf0c1-cb65-4127-9881-2ab4f271ad01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf', 'volume_name': 'volume-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81fdf57-0d68-4b0d-8dfc-ca2545413a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81fdf57-0d68-4b0d-8dfc-ca2545413a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c48882-ee7e-4b97-aa98-5aec364b771b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:32 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Volume 18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf', 'volume_size': 1} Jun 30 16:12:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:12:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:12:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:12:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:12:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:12:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:12:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:12:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:33 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:12:33 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:34 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.437s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:34 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:12:34 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:12:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 28 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:12:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:12:38 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fe20319c-14b4-44d4-a560-93ac7760c0a4" returned: 0 in 6.989s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:38 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[9608d099-c07d-43b1-96c1-72f153f75f89]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:12:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:38 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd Jun 30 16:12:38 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:39 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd" returned: 0 in 1.157s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:39 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Image conversion details: src /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd, size 1024.00 MB, duration 6.99 sec, destination /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fe20319c-14b4-44d4-a560-93ac7760c0a4 {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:12:39 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Converted 1024.00 MB image at 146.51 MB/s Jun 30 16:12:39 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fe20319c-14b4-44d4-a560-93ac7760c0a4 is being set with open permissions: ugo+rw Jun 30 16:12:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fe20319c-14b4-44d4-a560-93ac7760c0a4 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:39 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fe20319c-14b4-44d4-a560-93ac7760c0a4 Jun 30 16:12:39 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:40 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fe20319c-14b4-44d4-a560-93ac7760c0a4" returned: 0 in 0.740s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:40 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Lock "cinder-quobyte-fe20319c-14b4-44d4-a560-93ac7760c0a4" released by "_copy_volume_from_snapshot" :: held 10.916s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:12:40 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Acquiring lock "cinder-quobyte-1e051ca3-9cbf-4a4d-947e-3a21686ba930" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:12:40 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Lock "cinder-quobyte-1e051ca3-9cbf-4a4d-947e-3a21686ba930" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:12:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Deleting offline snapshot 1e051ca3-9cbf-4a4d-947e-3a21686ba930 of volume 165b9c47-b6db-48ed-b911-ca57e37512cd {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:12:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] snapshot_file for this snap is: volume-165b9c47-b6db-48ed-b911-ca57e37512cd.1e051ca3-9cbf-4a4d-947e-3a21686ba930 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:12:40 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2515064-3b5f-4f90-9d52-2c596380a459]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:12:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.1e051ca3-9cbf-4a4d-947e-3a21686ba930 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:40 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.1e051ca3-9cbf-4a4d-947e-3a21686ba930 Jun 30 16:12:40 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:41 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.1e051ca3-9cbf-4a4d-947e-3a21686ba930" returned: 0 in 1.146s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-165b9c47-b6db-48ed-b911-ca57e37512cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:12:41 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[df779ae3-1dc7-464a-8f98-9f942e1f7206]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:12:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:42 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd Jun 30 16:12:42 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:42 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd" returned: 0 in 0.840s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.1e051ca3-9cbf-4a4d-947e-3a21686ba930 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:42 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.1e051ca3-9cbf-4a4d-947e-3a21686ba930 Jun 30 16:12:42 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:44 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=34,cinder:INSERT=13,cinder:UPDATE=39,cinder:DELETE=2 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:12:44 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.1e051ca3-9cbf-4a4d-947e-3a21686ba930" returned: 0 in 1.302s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.1e051ca3-9cbf-4a4d-947e-3a21686ba930 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:44 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.1e051ca3-9cbf-4a4d-947e-3a21686ba930 Jun 30 16:12:44 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:45 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd.1e051ca3-9cbf-4a4d-947e-3a21686ba930" returned: 0 in 1.020s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Lock "cinder-quobyte-1e051ca3-9cbf-4a4d-947e-3a21686ba930" released by "_delete_snapshot" :: held 4.474s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:12:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.154s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:12:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.319s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:12:45 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2003200917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80bc3c5e-c67c-4531-bc11-702c5ed5cff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c9cf921a0b453fb116f792fcf8f47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:12:27Z,use_quota=True,user_id='32e984574d954d0a926927073189eafd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:12:45 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Creating volume 80bc3c5e-c67c-4531-bc11-702c5ed5cff1 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:12:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:12:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:12:45 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:12:45 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:12:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:12:45 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:12:45 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:12:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:45 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1 1073741824 Jun 30 16:12:45 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44220d4-5ac4-475e-a84f-8d964924855a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe20319c-14b4-44d4-a560-93ac7760c0a4', 'volume_size': 1, 'source_volid': '165b9c47-b6db-48ed-b911-ca57e37512cd', 'source_volstatus': 'available'}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:45 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2eca68-5729-437c-96be-2ae020c4882d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:45 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:45 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Volume volume-fe20319c-14b4-44d4-a560-93ac7760c0a4 (fe20319c-14b4-44d4-a560-93ac7760c0a4): created successfully Jun 30 16:12:45 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2eca68-5729-437c-96be-2ae020c4882d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:45 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Flow 'volume_create_manager' (b5f8a9ce-6479-4380-838b-1eb935d5f1e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:12:45 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-3f64744f-79d2-4cf3-8180-2a3bd0761481 tempest-VolumesGetTest-109886290 None] Created volume successfully. Jun 30 16:12:46 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1 1073741824" returned: 0 in 1.102s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:46 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1 Jun 30 16:12:46 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:47 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1" returned: 0 in 0.808s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] <== create_volume: return (1986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.234s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1106105028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b028e64314c04b4c9e91bce8353f2570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:12:32Z,use_quota=True,user_id='f524b50a50ba4120b490ab57be3f8b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Creating volume 18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:12:47 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:47 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf 1073741824 Jun 30 16:12:47 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Flow 'volume_create_manager' (d74a4f4d-6a85-47cb-b9f0-cd63c221d500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d4e0e03-f04d-4ea7-8cdc-fc49eecfd561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Attempting download of 2303c773-75d0-4542-ba21-750c84d63b39 ((None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}])) to volume 80bc3c5e-c67c-4531-bc11-702c5ed5cff1. {{(pid=93781) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d4e0e03-f04d-4ea7-8cdc-fc49eecfd561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:12:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1800771020',display_name='tempest-VolumesGetTest-Volume-2143902673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db2c40b-213a-4278-9d8b-2456070b3eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93140b29bfa4128a916707519452858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:12:47Z,use_quota=True,user_id='4edf3c3fc05d48fa8e44ae9f2327f8c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f96302-ad9e-4a72-9272-f704ca678493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f96302-ad9e-4a72-9272-f704ca678493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f771824-44a7-44c0-9571-58ab283f5c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f771824-44a7-44c0-9571-58ab283f5c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8db2c40b-213a-4278-9d8b-2456070b3eba', 'volume_name': 'volume-8db2c40b-213a-4278-9d8b-2456070b3eba', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d313c6-b772-40f6-891f-bce9cd88bc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d313c6-b772-40f6-891f-bce9cd88bc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b54b4709-0df8-4aaf-a7c8-23390a0d54a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:47 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Volume 8db2c40b-213a-4278-9d8b-2456070b3eba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8db2c40b-213a-4278-9d8b-2456070b3eba', 'volume_size': 1} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[1622e2d3-46ff-47e5-b572-e3da2cd89137]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:12:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_vyh1cl7y {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:47 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_vyh1cl7y Jun 30 16:12:47 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:48 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_vyh1cl7y" returned: 0 in 0.862s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_vyh1cl7y {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:48 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf 1073741824" returned: 0 in 1.179s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:48 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_vyh1cl7y Jun 30 16:12:48 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:48 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf Jun 30 16:12:48 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:49 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_vyh1cl7y" returned: 1 in 0.883s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_vyh1cl7y' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:12:49 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d285bb3-5237-44b6-bf6e-af09398cdc2a]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:12:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_f6g1h2w6devstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:49 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_f6g1h2w6devstack@QuobyteHD Jun 30 16:12:49 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:49 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf" returned: 0 in 0.937s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] <== create_volume: return (2200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:12:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.204s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:12:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.004s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:12:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:12:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1800771020',display_name='tempest-VolumesGetTest-Volume-2143902673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db2c40b-213a-4278-9d8b-2456070b3eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93140b29bfa4128a916707519452858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:12:47Z,use_quota=True,user_id='4edf3c3fc05d48fa8e44ae9f2327f8c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:12:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Creating volume 8db2c40b-213a-4278-9d8b-2456070b3eba {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:12:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:12:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:12:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:12:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:12:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:12:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:12:49 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:12:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8db2c40b-213a-4278-9d8b-2456070b3eba 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:49 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8db2c40b-213a-4278-9d8b-2456070b3eba 1073741824 Jun 30 16:12:49 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c48882-ee7e-4b97-aa98-5aec364b771b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258b81ae-c762-4ae1-a163-36be97b8749c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:49 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Volume volume-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf (18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf): created successfully Jun 30 16:12:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258b81ae-c762-4ae1-a163-36be97b8749c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Flow 'volume_create_manager' (7987ede9-bbf3-46cc-be65-06f8f47543fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:12:49 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-22c825d6-e630-4413-9c45-14b029592412 tempest-AttachVolumeNegativeTest-2129882576 None] Created volume successfully. Jun 30 16:12:50 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_f6g1h2w6devstack@QuobyteHD" returned: 0 in 1.007s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:50 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] 2303c773-75d0-4542-ba21-750c84d63b39 was qcow2, converting to raw {{(pid=93781) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 30 16:12:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_f6g1h2w6devstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:50 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_f6g1h2w6devstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1 Jun 30 16:12:50 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:50 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8db2c40b-213a-4278-9d8b-2456070b3eba 1073741824" returned: 0 in 1.033s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8db2c40b-213a-4278-9d8b-2456070b3eba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:50 devstack sudo[102437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8db2c40b-213a-4278-9d8b-2456070b3eba Jun 30 16:12:50 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:51 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8db2c40b-213a-4278-9d8b-2456070b3eba" returned: 0 in 0.823s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:51 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:12:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:12:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b54b4709-0df8-4aaf-a7c8-23390a0d54a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8db2c40b-213a-4278-9d8b-2456070b3eba', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919109f3-02ff-431e-898a-ba408135ddf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:51 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Volume volume-8db2c40b-213a-4278-9d8b-2456070b3eba (8db2c40b-213a-4278-9d8b-2456070b3eba): created successfully Jun 30 16:12:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919109f3-02ff-431e-898a-ba408135ddf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Flow 'volume_create_manager' (d74a4f4d-6a85-47cb-b9f0-cd63c221d500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:12:51 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-e107536e-aa0d-4082-8661-d7af2bf176a0 tempest-VolumesGetTest-109886290 None] Created volume successfully. Jun 30 16:12:51 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b9ecf590-7a62-49f9-bd73-40df80b1c138 tempest-VolumesGetTest-109886290 None] Acquiring lock "cinder-8db2c40b-213a-4278-9d8b-2456070b3eba-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:12:51 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b9ecf590-7a62-49f9-bd73-40df80b1c138 tempest-VolumesGetTest-109886290 None] Lock "cinder-8db2c40b-213a-4278-9d8b-2456070b3eba-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:12:51 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b9ecf590-7a62-49f9-bd73-40df80b1c138 tempest-VolumesGetTest-109886290 None] Acquiring lock "cinder-quobyte-8db2c40b-213a-4278-9d8b-2456070b3eba" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:12:51 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b9ecf590-7a62-49f9-bd73-40df80b1c138 tempest-VolumesGetTest-109886290 None] Lock "cinder-quobyte-8db2c40b-213a-4278-9d8b-2456070b3eba" acquired by "delete_volume" :: waited 0.014s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:12:51 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3096f9-3153-4662-a654-cf48a618a4a3]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:12:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b9ecf590-7a62-49f9-bd73-40df80b1c138 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8db2c40b-213a-4278-9d8b-2456070b3eba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:51 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8db2c40b-213a-4278-9d8b-2456070b3eba Jun 30 16:12:51 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:52 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b9ecf590-7a62-49f9-bd73-40df80b1c138 tempest-VolumesGetTest-109886290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8db2c40b-213a-4278-9d8b-2456070b3eba" returned: 0 in 0.858s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b9ecf590-7a62-49f9-bd73-40df80b1c138 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8db2c40b-213a-4278-9d8b-2456070b3eba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:52 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8db2c40b-213a-4278-9d8b-2456070b3eba Jun 30 16:12:52 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:52 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_f6g1h2w6devstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1" returned: 0 in 2.632s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:52 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_f6g1h2w6devstack@QuobyteHD, size 112.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1 {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:12:52 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Converted 112.00 MB image at 42.51 MB/s Jun 30 16:12:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:52 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1 1G Jun 30 16:12:52 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-8581aca9-2133-437a-97fd-fd3b96c66a8d req-ca28f3fa-dadb-4e90-b5c3-2799d43ebef6 tempest-AttachVolumeNegativeTest-2129882576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:12:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-8581aca9-2133-437a-97fd-fd3b96c66a8d req-ca28f3fa-dadb-4e90-b5c3-2799d43ebef6 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:12:53 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa78e60-6f7b-4747-9468-f1f286656ea5]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:12:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-8581aca9-2133-437a-97fd-fd3b96c66a8d req-ca28f3fa-dadb-4e90-b5c3-2799d43ebef6 tempest-AttachVolumeNegativeTest-2129882576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:53 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf Jun 30 16:12:53 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:53 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b9ecf590-7a62-49f9-bd73-40df80b1c138 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8db2c40b-213a-4278-9d8b-2456070b3eba" returned: 0 in 0.753s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:53 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b9ecf590-7a62-49f9-bd73-40df80b1c138 tempest-VolumesGetTest-109886290 None] Lock "cinder-quobyte-8db2c40b-213a-4278-9d8b-2456070b3eba" released by "delete_volume" :: held 1.671s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:12:53 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-b9ecf590-7a62-49f9-bd73-40df80b1c138 tempest-VolumesGetTest-109886290 None] Created reservations ['fbfc84bf-1039-4693-a596-21fd999383e5', 'f86303a5-68f3-4b3e-8cd8-2e053704507a', '3e858b44-5f60-4ba4-a0ed-c5d84d2fd47f', 'f62c6d92-9845-49ec-9472-b6c13bca6141'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:12:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b9ecf590-7a62-49f9-bd73-40df80b1c138 tempest-VolumesGetTest-109886290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:12:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b9ecf590-7a62-49f9-bd73-40df80b1c138 tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:12:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b9ecf590-7a62-49f9-bd73-40df80b1c138 tempest-VolumesGetTest-109886290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:12:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b9ecf590-7a62-49f9-bd73-40df80b1c138 tempest-VolumesGetTest-109886290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:12:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b9ecf590-7a62-49f9-bd73-40df80b1c138 tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:12:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b9ecf590-7a62-49f9-bd73-40df80b1c138 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:53 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:12:53 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:53 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1 1G" returned: 0 in 0.972s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:53 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f00915-71c7-46fa-856f-2275419f02a5]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:12:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:54 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1 Jun 30 16:12:54 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:54 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-39fc0562-1917-4663-9fe7-6a65c977a120 tempest-VolumesGetTest-109886290 None] Acquiring lock "cinder-fe20319c-14b4-44d4-a560-93ac7760c0a4-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:12:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-8581aca9-2133-437a-97fd-fd3b96c66a8d req-ca28f3fa-dadb-4e90-b5c3-2799d43ebef6 tempest-AttachVolumeNegativeTest-2129882576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf" returned: 0 in 0.960s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-8581aca9-2133-437a-97fd-fd3b96c66a8d req-ca28f3fa-dadb-4e90-b5c3-2799d43ebef6 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.990s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:12:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-39fc0562-1917-4663-9fe7-6a65c977a120 tempest-VolumesGetTest-109886290 None] Lock "cinder-fe20319c-14b4-44d4-a560-93ac7760c0a4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:12:54 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-8581aca9-2133-437a-97fd-fd3b96c66a8d req-ca28f3fa-dadb-4e90-b5c3-2799d43ebef6 tempest-AttachVolumeNegativeTest-2129882576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a', 'name': 'volume-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '304fd0d9-0599-463f-86e5-ec90b4b86194', 'enforce_multipath': True} {{(pid=93781) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 30 16:12:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-39fc0562-1917-4663-9fe7-6a65c977a120 tempest-VolumesGetTest-109886290 None] Acquiring lock "cinder-quobyte-fe20319c-14b4-44d4-a560-93ac7760c0a4" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:12:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-39fc0562-1917-4663-9fe7-6a65c977a120 tempest-VolumesGetTest-109886290 None] Lock "cinder-quobyte-fe20319c-14b4-44d4-a560-93ac7760c0a4" acquired by "delete_volume" :: waited 0.028s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:12:54 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d63117c-e175-49e4-a020-b99671b53bef]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:12:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-39fc0562-1917-4663-9fe7-6a65c977a120 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fe20319c-14b4-44d4-a560-93ac7760c0a4 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:54 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-8581aca9-2133-437a-97fd-fd3b96c66a8d req-ca28f3fa-dadb-4e90-b5c3-2799d43ebef6 tempest-AttachVolumeNegativeTest-2129882576 None] attachment_update completed successfully. Jun 30 16:12:54 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fe20319c-14b4-44d4-a560-93ac7760c0a4 Jun 30 16:12:54 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:54 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b9ecf590-7a62-49f9-bd73-40df80b1c138 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.743s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:54 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-b9ecf590-7a62-49f9-bd73-40df80b1c138 tempest-VolumesGetTest-109886290 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:12:54 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-b9ecf590-7a62-49f9-bd73-40df80b1c138 tempest-VolumesGetTest-109886290 None] Deleted volume successfully. Jun 30 16:12:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b9ecf590-7a62-49f9-bd73-40df80b1c138 tempest-VolumesGetTest-109886290 None] Lock "cinder-8db2c40b-213a-4278-9d8b-2456070b3eba-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:12:54 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1" returned: 0 in 1.017s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:55 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1 Jun 30 16:12:55 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:55 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-39fc0562-1917-4663-9fe7-6a65c977a120 tempest-VolumesGetTest-109886290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fe20319c-14b4-44d4-a560-93ac7760c0a4" returned: 0 in 0.961s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-39fc0562-1917-4663-9fe7-6a65c977a120 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fe20319c-14b4-44d4-a560-93ac7760c0a4 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:55 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fe20319c-14b4-44d4-a560-93ac7760c0a4 Jun 30 16:12:55 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:55 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1" returned: 1 in 0.951s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:12:55 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Downloaded image 2303c773-75d0-4542-ba21-750c84d63b39 ((None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}])) to volume 80bc3c5e-c67c-4531-bc11-702c5ed5cff1 successfully. {{(pid=93781) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 30 16:12:55 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Temporary image 2303c773-75d0-4542-ba21-750c84d63b39 for user 32e984574d954d0a926927073189eafd is deleted. {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 30 16:12:55 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Marking volume 80bc3c5e-c67c-4531-bc11-702c5ed5cff1 as bootable. {{(pid=93781) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 30 16:12:55 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Copying metadata from image 2303c773-75d0-4542-ba21-750c84d63b39 to 80bc3c5e-c67c-4531-bc11-702c5ed5cff1. {{(pid=93781) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 30 16:12:55 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Creating volume glance metadata for volume 80bc3c5e-c67c-4531-bc11-702c5ed5cff1 backed by image 2303c773-75d0-4542-ba21-750c84d63b39 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2303c773-75d0-4542-ba21-750c84d63b39', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93781) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 30 16:12:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f96922-4530-4d22-b1a7-b66bf00553dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1', 'volume_size': 1, 'image_id': '2303c773-75d0-4542-ba21-750c84d63b39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a85030669b0434f9a3a845e0c4388d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2303c773-75d0-4542-ba21-750c84d63b39', 'created_at': datetime.datetime(2026, 6, 30, 13, 59, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 13, 59, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2303c773-75d0-4542-ba21-750c84d63b39/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe83afe6-e487-4152-b6b4-b7f7bedfa9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:12:56 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-39fc0562-1917-4663-9fe7-6a65c977a120 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-fe20319c-14b4-44d4-a560-93ac7760c0a4" returned: 0 in 0.822s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:56 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Volume volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1 (80bc3c5e-c67c-4531-bc11-702c5ed5cff1): created successfully Jun 30 16:12:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe83afe6-e487-4152-b6b4-b7f7bedfa9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:12:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Flow 'volume_create_manager' (89de752f-611c-4d6a-b0b7-cee03c96c255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:12:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-39fc0562-1917-4663-9fe7-6a65c977a120 tempest-VolumesGetTest-109886290 None] Lock "cinder-quobyte-fe20319c-14b4-44d4-a560-93ac7760c0a4" released by "delete_volume" :: held 1.847s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:12:56 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-cd836f33-a24f-4205-be82-580ec161ab9d tempest-VolumesImageMetadata-786919515 None] Created volume successfully. Jun 30 16:12:56 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-39fc0562-1917-4663-9fe7-6a65c977a120 tempest-VolumesGetTest-109886290 None] Created reservations ['b0683444-e86f-46ff-80d6-9208eece722b', 'e54bdb54-6d70-460e-8987-5a7e340cc550', '7c1f794d-4b85-4100-bf3c-dc1bfd0fd453', '4ffebeea-5e85-4c11-a04e-96cc995c3f4f'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:12:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-39fc0562-1917-4663-9fe7-6a65c977a120 tempest-VolumesGetTest-109886290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:12:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-39fc0562-1917-4663-9fe7-6a65c977a120 tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:12:56 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-39fc0562-1917-4663-9fe7-6a65c977a120 tempest-VolumesGetTest-109886290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:12:56 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-39fc0562-1917-4663-9fe7-6a65c977a120 tempest-VolumesGetTest-109886290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:12:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-39fc0562-1917-4663-9fe7-6a65c977a120 tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:12:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-39fc0562-1917-4663-9fe7-6a65c977a120 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:56 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:12:56 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8426f248-1f76-45d0-ad68-3e85952832d6 tempest-VolumesGetTest-109886290 None] Acquiring lock "cinder-165b9c47-b6db-48ed-b911-ca57e37512cd-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:12:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8426f248-1f76-45d0-ad68-3e85952832d6 tempest-VolumesGetTest-109886290 None] Lock "cinder-165b9c47-b6db-48ed-b911-ca57e37512cd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:12:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8426f248-1f76-45d0-ad68-3e85952832d6 tempest-VolumesGetTest-109886290 None] Acquiring lock "cinder-quobyte-165b9c47-b6db-48ed-b911-ca57e37512cd" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:12:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8426f248-1f76-45d0-ad68-3e85952832d6 tempest-VolumesGetTest-109886290 None] Lock "cinder-quobyte-165b9c47-b6db-48ed-b911-ca57e37512cd" acquired by "delete_volume" :: waited 0.024s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:12:56 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[324d1dd2-bd9d-40fe-97df-44d425f5958c]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:12:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8426f248-1f76-45d0-ad68-3e85952832d6 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:56 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd Jun 30 16:12:56 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:56 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-39fc0562-1917-4663-9fe7-6a65c977a120 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.763s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:56 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-39fc0562-1917-4663-9fe7-6a65c977a120 tempest-VolumesGetTest-109886290 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:12:56 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-39fc0562-1917-4663-9fe7-6a65c977a120 tempest-VolumesGetTest-109886290 None] Deleted volume successfully. Jun 30 16:12:57 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-39fc0562-1917-4663-9fe7-6a65c977a120 tempest-VolumesGetTest-109886290 None] Lock "cinder-fe20319c-14b4-44d4-a560-93ac7760c0a4-delete_volume" released by "delete_volume" :: held 2.877s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:12:57 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c61801dc-e347-453f-897a-43dee1ebd97b tempest-VolumesImageMetadata-786919515 None] Acquiring lock "cinder-80bc3c5e-c67c-4531-bc11-702c5ed5cff1-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:12:57 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c61801dc-e347-453f-897a-43dee1ebd97b tempest-VolumesImageMetadata-786919515 None] Lock "cinder-80bc3c5e-c67c-4531-bc11-702c5ed5cff1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:12:57 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c61801dc-e347-453f-897a-43dee1ebd97b tempest-VolumesImageMetadata-786919515 None] Acquiring lock "cinder-quobyte-80bc3c5e-c67c-4531-bc11-702c5ed5cff1" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:12:57 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c61801dc-e347-453f-897a-43dee1ebd97b tempest-VolumesImageMetadata-786919515 None] Lock "cinder-quobyte-80bc3c5e-c67c-4531-bc11-702c5ed5cff1" acquired by "delete_volume" :: waited 0.023s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:12:57 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[256c45a0-06bc-400a-8bde-310f0bf1d3e1]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:12:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c61801dc-e347-453f-897a-43dee1ebd97b tempest-VolumesImageMetadata-786919515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:57 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1 Jun 30 16:12:57 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:57 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8426f248-1f76-45d0-ad68-3e85952832d6 tempest-VolumesGetTest-109886290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd" returned: 0 in 0.862s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8426f248-1f76-45d0-ad68-3e85952832d6 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:57 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd Jun 30 16:12:57 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:58 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8426f248-1f76-45d0-ad68-3e85952832d6 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-165b9c47-b6db-48ed-b911-ca57e37512cd" returned: 0 in 0.714s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:58 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8426f248-1f76-45d0-ad68-3e85952832d6 tempest-VolumesGetTest-109886290 None] Lock "cinder-quobyte-165b9c47-b6db-48ed-b911-ca57e37512cd" released by "delete_volume" :: held 1.662s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:12:58 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c61801dc-e347-453f-897a-43dee1ebd97b tempest-VolumesImageMetadata-786919515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1" returned: 0 in 0.992s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c61801dc-e347-453f-897a-43dee1ebd97b tempest-VolumesImageMetadata-786919515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:58 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-8426f248-1f76-45d0-ad68-3e85952832d6 tempest-VolumesGetTest-109886290 None] Created reservations ['1f39f690-710b-44ce-8d54-b122ac8c759f', '9acdf4a0-ade7-4c2d-98f9-7696b51417c2', '5d077e7b-4937-4b18-821c-4ada095b217e', '2854dfca-b1ef-485f-8b75-1fc1d290dc5f'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:12:58 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1 Jun 30 16:12:58 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8426f248-1f76-45d0-ad68-3e85952832d6 tempest-VolumesGetTest-109886290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:12:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8426f248-1f76-45d0-ad68-3e85952832d6 tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:12:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-8426f248-1f76-45d0-ad68-3e85952832d6 tempest-VolumesGetTest-109886290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:12:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-8426f248-1f76-45d0-ad68-3e85952832d6 tempest-VolumesGetTest-109886290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:12:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8426f248-1f76-45d0-ad68-3e85952832d6 tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:12:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8426f248-1f76-45d0-ad68-3e85952832d6 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:58 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:12:58 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:12:59 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8426f248-1f76-45d0-ad68-3e85952832d6 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.853s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:59 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-8426f248-1f76-45d0-ad68-3e85952832d6 tempest-VolumesGetTest-109886290 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:12:59 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-8426f248-1f76-45d0-ad68-3e85952832d6 tempest-VolumesGetTest-109886290 None] Deleted volume successfully. Jun 30 16:12:59 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8426f248-1f76-45d0-ad68-3e85952832d6 tempest-VolumesGetTest-109886290 None] Lock "cinder-165b9c47-b6db-48ed-b911-ca57e37512cd-delete_volume" released by "delete_volume" :: held 2.890s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:12:59 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Jun 30 16:12:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c61801dc-e347-453f-897a-43dee1ebd97b tempest-VolumesImageMetadata-786919515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1" returned: 1 in 1.291s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:12:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c61801dc-e347-453f-897a-43dee1ebd97b tempest-VolumesImageMetadata-786919515 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:12:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c61801dc-e347-453f-897a-43dee1ebd97b tempest-VolumesImageMetadata-786919515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:12:59 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1 Jun 30 16:12:59 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:00 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:13:00 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Flow 'volume_create_manager' (ac5b7fc3-573c-4d67-8be5-3eb30f74dac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:13:00 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325985c3-51b8-4ffa-b612-8a06b85853bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:00 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325985c3-51b8-4ffa-b612-8a06b85853bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1640606171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff021bb-65e9-44a5-af77-ce6bbc242e7c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e93140b29bfa4128a916707519452858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:13:00Z,use_quota=True,user_id='4edf3c3fc05d48fa8e44ae9f2327f8c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:00 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00989b9b-e7e2-4541-8fc3-50ffaf135e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:00 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00989b9b-e7e2-4541-8fc3-50ffaf135e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:00 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715cd521-05c9-4322-99e2-071355facbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:00 devstack cinder-volume[93781]: DEBUG cinder.image.glance [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Creating Keystone auth plugin from conf {{(pid=93781) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 30 16:13:00 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715cd521-05c9-4322-99e2-071355facbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9ff021bb-65e9-44a5-af77-ce6bbc242e7c', 'volume_name': 'volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c', 'volume_size': 1, 'image_id': '2303c773-75d0-4542-ba21-750c84d63b39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a85030669b0434f9a3a845e0c4388d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2303c773-75d0-4542-ba21-750c84d63b39', 'created_at': datetime.datetime(2026, 6, 30, 13, 59, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 13, 59, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2303c773-75d0-4542-ba21-750c84d63b39/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:00 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a63e8f1a-fd70-4726-87cc-48ec8636efb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:00 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a63e8f1a-fd70-4726-87cc-48ec8636efb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:00 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee24399-41f6-4bc9-8f17-69ce897dca66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:00 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Volume 9ff021bb-65e9-44a5-af77-ce6bbc242e7c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c', 'volume_size': 1, 'image_id': '2303c773-75d0-4542-ba21-750c84d63b39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a85030669b0434f9a3a845e0c4388d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2303c773-75d0-4542-ba21-750c84d63b39', 'created_at': datetime.datetime(2026, 6, 30, 13, 59, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 13, 59, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2303c773-75d0-4542-ba21-750c84d63b39/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 30 16:13:00 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Trying to clone 9ff021bb-65e9-44a5-af77-ce6bbc242e7c from image 2303c773-75d0-4542-ba21-750c84d63b39 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}]). {{(pid=93781) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 30 16:13:00 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c61801dc-e347-453f-897a-43dee1ebd97b tempest-VolumesImageMetadata-786919515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-80bc3c5e-c67c-4531-bc11-702c5ed5cff1" returned: 0 in 0.959s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c61801dc-e347-453f-897a-43dee1ebd97b tempest-VolumesImageMetadata-786919515 None] Lock "cinder-quobyte-80bc3c5e-c67c-4531-bc11-702c5ed5cff1" released by "delete_volume" :: held 3.313s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:13:00 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-c61801dc-e347-453f-897a-43dee1ebd97b tempest-VolumesImageMetadata-786919515 None] Created reservations ['37ea2851-b8fe-4410-8a0d-a1d5cc0ec83e', '04f2e507-2a26-4a28-a005-66422b7eec8e', 'd51d30a3-9aea-4c9c-9ebf-13268206b1d1', '125b02e5-5b40-432f-90c6-57eb5b6929ec'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:13:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c61801dc-e347-453f-897a-43dee1ebd97b tempest-VolumesImageMetadata-786919515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:13:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c61801dc-e347-453f-897a-43dee1ebd97b tempest-VolumesImageMetadata-786919515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:13:00 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c61801dc-e347-453f-897a-43dee1ebd97b tempest-VolumesImageMetadata-786919515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:13:00 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c61801dc-e347-453f-897a-43dee1ebd97b tempest-VolumesImageMetadata-786919515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:13:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c61801dc-e347-453f-897a-43dee1ebd97b tempest-VolumesImageMetadata-786919515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:13:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c61801dc-e347-453f-897a-43dee1ebd97b tempest-VolumesImageMetadata-786919515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:00 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:13:00 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:01 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_i56v3k8mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 30 16:13:01 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Image download 20.69 MB at 20.69 MB/s Jun 30 16:13:01 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa2b1a9-1f31-43a6-9830-e2c3a3bb24cd]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:13:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_i56v3k8mdevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:01 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_i56v3k8mdevstack@QuobyteHD Jun 30 16:13:01 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:01 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c61801dc-e347-453f-897a-43dee1ebd97b tempest-VolumesImageMetadata-786919515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.811s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:01 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-c61801dc-e347-453f-897a-43dee1ebd97b tempest-VolumesImageMetadata-786919515 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:13:01 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-c61801dc-e347-453f-897a-43dee1ebd97b tempest-VolumesImageMetadata-786919515 None] Deleted volume successfully. Jun 30 16:13:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c61801dc-e347-453f-897a-43dee1ebd97b tempest-VolumesImageMetadata-786919515 None] Lock "cinder-80bc3c5e-c67c-4531-bc11-702c5ed5cff1-delete_volume" released by "delete_volume" :: held 4.570s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:13:02 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_i56v3k8mdevstack@QuobyteHD" returned: 0 in 1.079s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Temporary image 2303c773-75d0-4542-ba21-750c84d63b39 is fetched for user 4edf3c3fc05d48fa8e44ae9f2327f8c0. {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Flow 'volume_create_manager' (1670ea20-2f44-4e5b-9fe4-37a5030e277b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbbbc32-19f4-4221-bcb5-7bfedcccd32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbbbc32-19f4-4221-bcb5-7bfedcccd32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1523960071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df631280-fb1a-456e-b6f7-6290ee5d3a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be84181e4b8d4fc1b3bbd362973a4294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:13:02Z,use_quota=True,user_id='d1d1ff2af51d46b69f312280d062f3db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45c79e0-7760-471a-86d4-c69bb5f0b482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45c79e0-7760-471a-86d4-c69bb5f0b482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5373a4ac-7628-4a84-8493-7ee712d45ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5373a4ac-7628-4a84-8493-7ee712d45ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df631280-fb1a-456e-b6f7-6290ee5d3a11', 'volume_name': 'volume-df631280-fb1a-456e-b6f7-6290ee5d3a11', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce4faa32-5ade-487a-857a-f5f3e8aa1465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce4faa32-5ade-487a-857a-f5f3e8aa1465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36191f48-4f9f-4548-9f06-0372c50804cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:02 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Volume df631280-fb1a-456e-b6f7-6290ee5d3a11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df631280-fb1a-456e-b6f7-6290ee5d3a11', 'volume_size': 1} Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1523960071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df631280-fb1a-456e-b6f7-6290ee5d3a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be84181e4b8d4fc1b3bbd362973a4294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:13:02Z,use_quota=True,user_id='d1d1ff2af51d46b69f312280d062f3db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Creating volume df631280-fb1a-456e-b6f7-6290ee5d3a11 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:13:02 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-df631280-fb1a-456e-b6f7-6290ee5d3a11 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:02 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-df631280-fb1a-456e-b6f7-6290ee5d3a11 1073741824 Jun 30 16:13:02 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[729b0130-ff05-4049-b3ae-61af212fd352]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:13:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_i56v3k8mdevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:02 devstack sudo[102954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_i56v3k8mdevstack@QuobyteHD Jun 30 16:13:02 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:03 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_i56v3k8mdevstack@QuobyteHD" returned: 0 in 1.346s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:13:03 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-df631280-fb1a-456e-b6f7-6290ee5d3a11 1073741824" returned: 0 in 1.537s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-df631280-fb1a-456e-b6f7-6290ee5d3a11 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:03 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-df631280-fb1a-456e-b6f7-6290ee5d3a11 Jun 30 16:13:03 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:04 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-df631280-fb1a-456e-b6f7-6290ee5d3a11" returned: 0 in 0.758s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:04 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] <== create_volume: return (2356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:13:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.360s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:13:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.947s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:13:04 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1640606171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff021bb-65e9-44a5-af77-ce6bbc242e7c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e93140b29bfa4128a916707519452858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:13:00Z,use_quota=True,user_id='4edf3c3fc05d48fa8e44ae9f2327f8c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:13:04 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Creating volume 9ff021bb-65e9-44a5-af77-ce6bbc242e7c {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:13:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:13:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:13:04 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:13:04 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:13:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:13:04 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:13:04 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:13:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:04 devstack sudo[103006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c 1073741824 Jun 30 16:13:04 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:04 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36191f48-4f9f-4548-9f06-0372c50804cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df631280-fb1a-456e-b6f7-6290ee5d3a11', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:04 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13a24db-fae6-452b-89a5-5a904670cd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:04 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:UPDATE=96,cinder:DELETE=9,cinder:SELECT=72,cinder:INSERT=27 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:13:04 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Volume volume-df631280-fb1a-456e-b6f7-6290ee5d3a11 (df631280-fb1a-456e-b6f7-6290ee5d3a11): created successfully Jun 30 16:13:04 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13a24db-fae6-452b-89a5-5a904670cd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:04 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Flow 'volume_create_manager' (1670ea20-2f44-4e5b-9fe4-37a5030e277b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:13:04 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-d1af1db0-4d45-4934-b7c5-656b2094bfb1 tempest-AttachVolumeTestJSON-1554772577 None] Created volume successfully. Jun 30 16:13:05 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c 1073741824" returned: 0 in 1.169s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:05 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c Jun 30 16:13:05 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:06 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c" returned: 0 in 0.843s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] <== create_volume: return (2065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:13:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.068s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:13:06 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Attempting download of 2303c773-75d0-4542-ba21-750c84d63b39 ((None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}])) to volume 9ff021bb-65e9-44a5-af77-ce6bbc242e7c. {{(pid=93781) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 30 16:13:06 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[c275794b-eea0-40ff-acdc-2b27274230ab]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:13:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_0buafkc3 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:06 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_0buafkc3 Jun 30 16:13:06 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:07 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_0buafkc3" returned: 0 in 0.768s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_0buafkc3 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:07 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_0buafkc3 Jun 30 16:13:07 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:08 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_0buafkc3" returned: 1 in 0.846s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_0buafkc3' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:13:08 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d6a309-34c4-4899-b1df-f2267be63491]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:13:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_i56v3k8mdevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-cb62ca32-b8e7-4627-be07-2b6ee3f8c482 req-30dc5f56-0cba-47a0-bc5d-4c7032c53e35 tempest-AttachVolumeTestJSON-1554772577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:13:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-cb62ca32-b8e7-4627-be07-2b6ee3f8c482 req-30dc5f56-0cba-47a0-bc5d-4c7032c53e35 tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:13:08 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_i56v3k8mdevstack@QuobyteHD Jun 30 16:13:08 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:08 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1877e6-ae79-4885-9dcb-5d035078583b]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:13:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-cb62ca32-b8e7-4627-be07-2b6ee3f8c482 req-30dc5f56-0cba-47a0-bc5d-4c7032c53e35 tempest-AttachVolumeTestJSON-1554772577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-df631280-fb1a-456e-b6f7-6290ee5d3a11 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:08 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-df631280-fb1a-456e-b6f7-6290ee5d3a11 Jun 30 16:13:08 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:09 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_i56v3k8mdevstack@QuobyteHD" returned: 0 in 1.149s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:09 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] 2303c773-75d0-4542-ba21-750c84d63b39 was qcow2, converting to raw {{(pid=93781) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 30 16:13:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_i56v3k8mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:09 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_i56v3k8mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c Jun 30 16:13:09 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:09 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-cb62ca32-b8e7-4627-be07-2b6ee3f8c482 req-30dc5f56-0cba-47a0-bc5d-4c7032c53e35 tempest-AttachVolumeTestJSON-1554772577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-df631280-fb1a-456e-b6f7-6290ee5d3a11" returned: 0 in 1.013s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-cb62ca32-b8e7-4627-be07-2b6ee3f8c482 req-30dc5f56-0cba-47a0-bc5d-4c7032c53e35 tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.044s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:13:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-cb62ca32-b8e7-4627-be07-2b6ee3f8c482 req-30dc5f56-0cba-47a0-bc5d-4c7032c53e35 tempest-AttachVolumeTestJSON-1554772577 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a', 'name': 'volume-df631280-fb1a-456e-b6f7-6290ee5d3a11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '726d8460-b5cb-451e-a83e-90bba858f693', 'enforce_multipath': True} {{(pid=93781) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 30 16:13:09 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-cb62ca32-b8e7-4627-be07-2b6ee3f8c482 req-30dc5f56-0cba-47a0-bc5d-4c7032c53e35 tempest-AttachVolumeTestJSON-1554772577 None] attachment_update completed successfully. Jun 30 16:13:12 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_i56v3k8mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c" returned: 0 in 2.948s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:12 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_i56v3k8mdevstack@QuobyteHD, size 112.00 MB, duration 2.95 sec, destination /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:13:12 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Converted 112.00 MB image at 37.96 MB/s Jun 30 16:13:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:12 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c 1G Jun 30 16:13:12 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:13 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c 1G" returned: 0 in 0.760s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:13 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb88c05-9722-4c4d-85a1-6d7ae32df3a5]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:13:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:13 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c Jun 30 16:13:13 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:14 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c" returned: 0 in 0.882s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:14 devstack sudo[103096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c Jun 30 16:13:14 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:15 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c" returned: 1 in 0.897s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Downloaded image 2303c773-75d0-4542-ba21-750c84d63b39 ((None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}])) to volume 9ff021bb-65e9-44a5-af77-ce6bbc242e7c successfully. {{(pid=93781) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Temporary image 2303c773-75d0-4542-ba21-750c84d63b39 for user 4edf3c3fc05d48fa8e44ae9f2327f8c0 is deleted. {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Marking volume 9ff021bb-65e9-44a5-af77-ce6bbc242e7c as bootable. {{(pid=93781) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Copying metadata from image 2303c773-75d0-4542-ba21-750c84d63b39 to 9ff021bb-65e9-44a5-af77-ce6bbc242e7c. {{(pid=93781) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Creating volume glance metadata for volume 9ff021bb-65e9-44a5-af77-ce6bbc242e7c backed by image 2303c773-75d0-4542-ba21-750c84d63b39 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2303c773-75d0-4542-ba21-750c84d63b39', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93781) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee24399-41f6-4bc9-8f17-69ce897dca66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c', 'volume_size': 1, 'image_id': '2303c773-75d0-4542-ba21-750c84d63b39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a85030669b0434f9a3a845e0c4388d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2303c773-75d0-4542-ba21-750c84d63b39', 'created_at': datetime.datetime(2026, 6, 30, 13, 59, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 13, 59, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2303c773-75d0-4542-ba21-750c84d63b39/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea03bfe-0ff3-41d7-8fec-264a0af19261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:15 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Volume volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c (9ff021bb-65e9-44a5-af77-ce6bbc242e7c): created successfully Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea03bfe-0ff3-41d7-8fec-264a0af19261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Flow 'volume_create_manager' (ac5b7fc3-573c-4d67-8be5-3eb30f74dac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:13:15 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-e96271eb-448d-4d2c-a1e7-4f50cb8c3d16 tempest-VolumesGetTest-109886290 None] Created volume successfully. Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Flow 'volume_create_manager' (db7cae6f-5e85-4918-85e7-e5e88252401d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549122fb-8870-4e50-8ea7-e4b61ca0201a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549122fb-8870-4e50-8ea7-e4b61ca0201a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1049758366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685989a9-8497-4ba3-8e88-a777d01c1026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be84181e4b8d4fc1b3bbd362973a4294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:13:16Z,use_quota=True,user_id='d1d1ff2af51d46b69f312280d062f3db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ffd697-c1fa-456a-997c-b007863d1bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ffd697-c1fa-456a-997c-b007863d1bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c100714-7b93-4d91-91c2-b6180c1daae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c100714-7b93-4d91-91c2-b6180c1daae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '685989a9-8497-4ba3-8e88-a777d01c1026', 'volume_name': 'volume-685989a9-8497-4ba3-8e88-a777d01c1026', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de851073-a31e-4886-801c-382f9c2ae84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de851073-a31e-4886-801c-382f9c2ae84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e96856-a06f-4464-9071-cbf89f1133bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:15 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Volume 685989a9-8497-4ba3-8e88-a777d01c1026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-685989a9-8497-4ba3-8e88-a777d01c1026', 'volume_size': 1} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1049758366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685989a9-8497-4ba3-8e88-a777d01c1026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be84181e4b8d4fc1b3bbd362973a4294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:13:16Z,use_quota=True,user_id='d1d1ff2af51d46b69f312280d062f3db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Creating volume 685989a9-8497-4ba3-8e88-a777d01c1026 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:13:15 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:13:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-685989a9-8497-4ba3-8e88-a777d01c1026 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:16 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-685989a9-8497-4ba3-8e88-a777d01c1026 1073741824 Jun 30 16:13:16 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:17 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-685989a9-8497-4ba3-8e88-a777d01c1026 1073741824" returned: 0 in 1.181s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-685989a9-8497-4ba3-8e88-a777d01c1026 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:17 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-685989a9-8497-4ba3-8e88-a777d01c1026 Jun 30 16:13:17 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:17 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:13:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Flow 'volume_create_manager' (34ac6d94-26d9-4c57-9e96-504700451697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:13:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f5a495-2a14-4f30-9975-79bb8cd49555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f5a495-2a14-4f30-9975-79bb8cd49555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:13:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-900907198',display_name='tempest-VolumesGetTest-Volume-1561231356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095efa22-f4dc-4182-a570-f4a89588a306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93140b29bfa4128a916707519452858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:13:17Z,use_quota=True,user_id='4edf3c3fc05d48fa8e44ae9f2327f8c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6accb7-0ac0-49b8-908a-2a6486fef25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6accb7-0ac0-49b8-908a-2a6486fef25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e24aafe-bdd7-4721-8df8-3e7dc0767a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e24aafe-bdd7-4721-8df8-3e7dc0767a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '095efa22-f4dc-4182-a570-f4a89588a306', 'volume_name': 'volume-095efa22-f4dc-4182-a570-f4a89588a306', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (582d557d-3ecf-431f-a418-4b36460c2f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (582d557d-3ecf-431f-a418-4b36460c2f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3dadde4-f5b8-4bd6-bc23-8e8c26f22c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:17 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Volume 095efa22-f4dc-4182-a570-f4a89588a306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-095efa22-f4dc-4182-a570-f4a89588a306', 'volume_size': 1} Jun 30 16:13:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:13:18 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-685989a9-8497-4ba3-8e88-a777d01c1026" returned: 0 in 1.170s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:18 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] <== create_volume: return (2431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:13:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.433s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:13:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.872s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:13:18 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:13:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-900907198',display_name='tempest-VolumesGetTest-Volume-1561231356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095efa22-f4dc-4182-a570-f4a89588a306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93140b29bfa4128a916707519452858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:13:17Z,use_quota=True,user_id='4edf3c3fc05d48fa8e44ae9f2327f8c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:13:18 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Creating volume 095efa22-f4dc-4182-a570-f4a89588a306 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:13:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:13:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:13:18 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:13:18 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:13:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:13:18 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:13:18 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:13:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-095efa22-f4dc-4182-a570-f4a89588a306 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e96856-a06f-4464-9071-cbf89f1133bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-685989a9-8497-4ba3-8e88-a777d01c1026', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f68129f-057d-41ad-8dc3-7aa375ef341b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:18 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Volume volume-685989a9-8497-4ba3-8e88-a777d01c1026 (685989a9-8497-4ba3-8e88-a777d01c1026): created successfully Jun 30 16:13:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f68129f-057d-41ad-8dc3-7aa375ef341b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Flow 'volume_create_manager' (db7cae6f-5e85-4918-85e7-e5e88252401d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:13:18 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-095efa22-f4dc-4182-a570-f4a89588a306 1073741824 Jun 30 16:13:18 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:18 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-9211cf3e-79f3-45a3-9524-cf0c0103f340 tempest-AttachVolumeTestJSON-1554772577 None] Created volume successfully. Jun 30 16:13:19 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-095efa22-f4dc-4182-a570-f4a89588a306 1073741824" returned: 0 in 1.333s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-095efa22-f4dc-4182-a570-f4a89588a306 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:19 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-095efa22-f4dc-4182-a570-f4a89588a306 Jun 30 16:13:19 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:20 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-095efa22-f4dc-4182-a570-f4a89588a306" returned: 0 in 1.080s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:20 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] <== create_volume: return (2515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:13:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.519s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:13:20 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3dadde4-f5b8-4bd6-bc23-8e8c26f22c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-095efa22-f4dc-4182-a570-f4a89588a306', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:20 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ef3fff-189b-4fad-bc64-2ec350701416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:21 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Volume volume-095efa22-f4dc-4182-a570-f4a89588a306 (095efa22-f4dc-4182-a570-f4a89588a306): created successfully Jun 30 16:13:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ef3fff-189b-4fad-bc64-2ec350701416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Flow 'volume_create_manager' (34ac6d94-26d9-4c57-9e96-504700451697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:13:21 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-6bf9a6ba-8a1e-46d2-87db-990bf674ab15 tempest-VolumesGetTest-109886290 None] Created volume successfully. Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-82d6752e-ee89-4172-b8dc-47ba07b90f89 tempest-VolumesGetTest-109886290 None] Acquiring lock "cinder-095efa22-f4dc-4182-a570-f4a89588a306-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-82d6752e-ee89-4172-b8dc-47ba07b90f89 tempest-VolumesGetTest-109886290 None] Lock "cinder-095efa22-f4dc-4182-a570-f4a89588a306-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-82d6752e-ee89-4172-b8dc-47ba07b90f89 tempest-VolumesGetTest-109886290 None] Acquiring lock "cinder-quobyte-095efa22-f4dc-4182-a570-f4a89588a306" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-82d6752e-ee89-4172-b8dc-47ba07b90f89 tempest-VolumesGetTest-109886290 None] Lock "cinder-quobyte-095efa22-f4dc-4182-a570-f4a89588a306" acquired by "delete_volume" :: waited 0.020s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58f06e8-0f8b-4101-87d0-1db24c1d3c3d]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-82d6752e-ee89-4172-b8dc-47ba07b90f89 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-095efa22-f4dc-4182-a570-f4a89588a306 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Flow 'volume_create_manager' (5f5e7980-317c-48ad-8e5f-322abf1d76dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:13:22 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-095efa22-f4dc-4182-a570-f4a89588a306 Jun 30 16:13:22 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9eb8044-7468-4852-b13b-75b9dcae1233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9eb8044-7468-4852-b13b-75b9dcae1233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1363476457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f44ba4ac-5773-4ad1-861b-ee6d1ae66a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7ba51f0d9a94981b719a71d4ce559eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:13:22Z,use_quota=True,user_id='f138ed1e2c744bbab9309f89c893b1c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (114f509b-c052-41e1-8f09-dbba09efba22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (114f509b-c052-41e1-8f09-dbba09efba22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5ed8b5-74b1-4d8b-b953-73511b51a1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5ed8b5-74b1-4d8b-b953-73511b51a1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f44ba4ac-5773-4ad1-861b-ee6d1ae66a67', 'volume_name': 'volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39799c0e-2f8f-4602-893f-fbcd7d75334a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39799c0e-2f8f-4602-893f-fbcd7d75334a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b04ad10-7705-4db8-aa73-23ec4da216d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:22 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Volume f44ba4ac-5773-4ad1-861b-ee6d1ae66a67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67', 'volume_size': 1} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1363476457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f44ba4ac-5773-4ad1-861b-ee6d1ae66a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7ba51f0d9a94981b719a71d4ce559eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:13:22Z,use_quota=True,user_id='f138ed1e2c744bbab9309f89c893b1c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Creating volume f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:13:22 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:22 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 1073741824 Jun 30 16:13:22 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-84441006-c02a-4cd7-99c6-03a069c99a93 req-ff32bfcd-1e9b-44e0-b40a-8ab6abd84154 tempest-AttachVolumeTestJSON-1554772577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:13:23 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-82d6752e-ee89-4172-b8dc-47ba07b90f89 tempest-VolumesGetTest-109886290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-095efa22-f4dc-4182-a570-f4a89588a306" returned: 0 in 1.219s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-82d6752e-ee89-4172-b8dc-47ba07b90f89 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-095efa22-f4dc-4182-a570-f4a89588a306 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:23 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-095efa22-f4dc-4182-a570-f4a89588a306 Jun 30 16:13:23 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:23 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 1073741824" returned: 0 in 1.220s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:23 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 Jun 30 16:13:23 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:24 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-82d6752e-ee89-4172-b8dc-47ba07b90f89 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-095efa22-f4dc-4182-a570-f4a89588a306" returned: 0 in 1.047s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:24 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-82d6752e-ee89-4172-b8dc-47ba07b90f89 tempest-VolumesGetTest-109886290 None] Lock "cinder-quobyte-095efa22-f4dc-4182-a570-f4a89588a306" released by "delete_volume" :: held 2.363s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:13:24 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-82d6752e-ee89-4172-b8dc-47ba07b90f89 tempest-VolumesGetTest-109886290 None] Created reservations ['3aab825e-60e9-4bee-9cdf-030cb93805b4', 'f9644c6a-1d07-4bec-8c8c-ecf745ce94d4', 'fb7dcdc3-0eed-4461-a8a8-629065d98c45', 'f6fd05cf-358c-4176-a58a-284b18389772'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:13:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-82d6752e-ee89-4172-b8dc-47ba07b90f89 tempest-VolumesGetTest-109886290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:13:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-82d6752e-ee89-4172-b8dc-47ba07b90f89 tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:13:24 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-82d6752e-ee89-4172-b8dc-47ba07b90f89 tempest-VolumesGetTest-109886290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:13:24 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-82d6752e-ee89-4172-b8dc-47ba07b90f89 tempest-VolumesGetTest-109886290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:13:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-82d6752e-ee89-4172-b8dc-47ba07b90f89 tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:13:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-82d6752e-ee89-4172-b8dc-47ba07b90f89 tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:24 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:13:24 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:24 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67" returned: 0 in 0.855s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:24 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] <== create_volume: return (2217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:13:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.219s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:13:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-84441006-c02a-4cd7-99c6-03a069c99a93 req-ff32bfcd-1e9b-44e0-b40a-8ab6abd84154 tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.996s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:13:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b04ad10-7705-4db8-aa73-23ec4da216d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3edbf696-0f20-49fa-abfd-4c7851ee9b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:24 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[05de8bbe-e8f1-4855-b052-77982c56389f]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:13:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-84441006-c02a-4cd7-99c6-03a069c99a93 req-ff32bfcd-1e9b-44e0-b40a-8ab6abd84154 tempest-AttachVolumeTestJSON-1554772577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-685989a9-8497-4ba3-8e88-a777d01c1026 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:24 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Volume volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 (f44ba4ac-5773-4ad1-861b-ee6d1ae66a67): created successfully Jun 30 16:13:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3edbf696-0f20-49fa-abfd-4c7851ee9b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Flow 'volume_create_manager' (5f5e7980-317c-48ad-8e5f-322abf1d76dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:13:24 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-d32a1734-be2a-43a9-b714-80f7268f9e99 tempest-VolumesActionsTest-828599955 None] Created volume successfully. Jun 30 16:13:24 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-685989a9-8497-4ba3-8e88-a777d01c1026 Jun 30 16:13:24 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ff17296a-af07-4e54-ab46-5c6eca0b360c tempest-VolumesGetTest-109886290 None] Acquiring lock "cinder-9ff021bb-65e9-44a5-af77-ce6bbc242e7c-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:13:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ff17296a-af07-4e54-ab46-5c6eca0b360c tempest-VolumesGetTest-109886290 None] Lock "cinder-9ff021bb-65e9-44a5-af77-ce6bbc242e7c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:13:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ff17296a-af07-4e54-ab46-5c6eca0b360c tempest-VolumesGetTest-109886290 None] Acquiring lock "cinder-quobyte-9ff021bb-65e9-44a5-af77-ce6bbc242e7c" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:13:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ff17296a-af07-4e54-ab46-5c6eca0b360c tempest-VolumesGetTest-109886290 None] Lock "cinder-quobyte-9ff021bb-65e9-44a5-af77-ce6bbc242e7c" acquired by "delete_volume" :: waited 0.042s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:13:26 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[90be769b-5bd7-47f5-affc-27ec89d9fcce]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:13:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ff17296a-af07-4e54-ab46-5c6eca0b360c tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:26 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-82d6752e-ee89-4172-b8dc-47ba07b90f89 tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.267s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:26 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-82d6752e-ee89-4172-b8dc-47ba07b90f89 tempest-VolumesGetTest-109886290 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:13:26 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-82d6752e-ee89-4172-b8dc-47ba07b90f89 tempest-VolumesGetTest-109886290 None] Deleted volume successfully. Jun 30 16:13:26 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-84441006-c02a-4cd7-99c6-03a069c99a93 req-ff32bfcd-1e9b-44e0-b40a-8ab6abd84154 tempest-AttachVolumeTestJSON-1554772577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-685989a9-8497-4ba3-8e88-a777d01c1026" returned: 0 in 1.225s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-84441006-c02a-4cd7-99c6-03a069c99a93 req-ff32bfcd-1e9b-44e0-b40a-8ab6abd84154 tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.261s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:13:26 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-82d6752e-ee89-4172-b8dc-47ba07b90f89 tempest-VolumesGetTest-109886290 None] Lock "cinder-095efa22-f4dc-4182-a570-f4a89588a306-delete_volume" released by "delete_volume" :: held 3.906s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:13:26 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-84441006-c02a-4cd7-99c6-03a069c99a93 req-ff32bfcd-1e9b-44e0-b40a-8ab6abd84154 tempest-AttachVolumeTestJSON-1554772577 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a', 'name': 'volume-685989a9-8497-4ba3-8e88-a777d01c1026', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd1e627df-e3b4-4cfb-bffa-c9a47c7e8967', 'enforce_multipath': True} {{(pid=93781) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 30 16:13:26 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-84441006-c02a-4cd7-99c6-03a069c99a93 req-ff32bfcd-1e9b-44e0-b40a-8ab6abd84154 tempest-AttachVolumeTestJSON-1554772577 None] attachment_update completed successfully. Jun 30 16:13:26 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c Jun 30 16:13:26 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:27 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ff17296a-af07-4e54-ab46-5c6eca0b360c tempest-VolumesGetTest-109886290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c" returned: 0 in 1.252s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ff17296a-af07-4e54-ab46-5c6eca0b360c tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:27 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c Jun 30 16:13:27 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:28 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ff17296a-af07-4e54-ab46-5c6eca0b360c tempest-VolumesGetTest-109886290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c" returned: 1 in 0.779s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ff17296a-af07-4e54-ab46-5c6eca0b360c tempest-VolumesGetTest-109886290 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:13:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ff17296a-af07-4e54-ab46-5c6eca0b360c tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:28 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c Jun 30 16:13:28 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:28 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ff17296a-af07-4e54-ab46-5c6eca0b360c tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9ff021bb-65e9-44a5-af77-ce6bbc242e7c" returned: 0 in 0.859s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:28 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ff17296a-af07-4e54-ab46-5c6eca0b360c tempest-VolumesGetTest-109886290 None] Lock "cinder-quobyte-9ff021bb-65e9-44a5-af77-ce6bbc242e7c" released by "delete_volume" :: held 3.005s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:13:29 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-ff17296a-af07-4e54-ab46-5c6eca0b360c tempest-VolumesGetTest-109886290 None] Created reservations ['c9062338-7542-430e-8a80-453cb4279db3', 'aef51ffc-8017-44f1-829c-1822496bd086', 'ebe81e34-1e59-402c-a15d-b88d0f1c21c0', 'cc5a17ba-3cc1-42f1-a8f6-8dba4635b27d'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:13:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ff17296a-af07-4e54-ab46-5c6eca0b360c tempest-VolumesGetTest-109886290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:13:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ff17296a-af07-4e54-ab46-5c6eca0b360c tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:13:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ff17296a-af07-4e54-ab46-5c6eca0b360c tempest-VolumesGetTest-109886290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:13:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ff17296a-af07-4e54-ab46-5c6eca0b360c tempest-VolumesGetTest-109886290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:13:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ff17296a-af07-4e54-ab46-5c6eca0b360c tempest-VolumesGetTest-109886290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:13:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ff17296a-af07-4e54-ab46-5c6eca0b360c tempest-VolumesGetTest-109886290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:29 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:13:29 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:30 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ff17296a-af07-4e54-ab46-5c6eca0b360c tempest-VolumesGetTest-109886290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.954s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:30 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-ff17296a-af07-4e54-ab46-5c6eca0b360c tempest-VolumesGetTest-109886290 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:13:30 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-ff17296a-af07-4e54-ab46-5c6eca0b360c tempest-VolumesGetTest-109886290 None] Deleted volume successfully. Jun 30 16:13:30 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ff17296a-af07-4e54-ab46-5c6eca0b360c tempest-VolumesGetTest-109886290 None] Lock "cinder-9ff021bb-65e9-44a5-af77-ce6bbc242e7c-delete_volume" released by "delete_volume" :: held 4.295s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:13:32 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-c6a69ac4-119e-4d4a-a22e-30a419848a85 req-e2201547-6d28-4745-8232-a6cfc908a27c tempest-AttachVolumeTestJSON-1554772577 None] Terminate volume connection completed successfully. Jun 30 16:13:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-c6a69ac4-119e-4d4a-a22e-30a419848a85 req-e2201547-6d28-4745-8232-a6cfc908a27c tempest-AttachVolumeTestJSON-1554772577 None] Deleting attachment 726d8460-b5cb-451e-a83e-90bba858f693. {{(pid=93781) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 30 16:13:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:13:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:13:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:13:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:13:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:13:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:13:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:33 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:13:33 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:34 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.026s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:34 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:13:34 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:13:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 28 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:13:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:13:36 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-5f437d52-da65-4b91-be24-6d4c2277b8b2 req-0ad572f6-2016-4089-8760-0f3d9980b6f5 tempest-AttachVolumeTestJSON-1554772577 None] Terminate volume connection completed successfully. Jun 30 16:13:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-5f437d52-da65-4b91-be24-6d4c2277b8b2 req-0ad572f6-2016-4089-8760-0f3d9980b6f5 tempest-AttachVolumeTestJSON-1554772577 None] Deleting attachment d1e627df-e3b4-4cfb-bffa-c9a47c7e8967. {{(pid=93781) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 30 16:13:36 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:13:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Flow 'volume_create_manager' (acbe384a-a96f-4ae8-a827-79a61c78b9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:13:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779021d7-bfda-4483-85a8-307191923af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779021d7-bfda-4483-85a8-307191923af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-882936367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c711e2f-bd57-447f-8a78-09d30eaf08f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf042eaa6bab455d986e74b152346ed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:13:37Z,use_quota=True,user_id='35432995d03c4993a8ebf61cd91919c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ae172e-8002-4ab8-9738-0635dfb2552b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ae172e-8002-4ab8-9738-0635dfb2552b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a75c54-0ca4-439b-abe7-f9881acf91e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a75c54-0ca4-439b-abe7-f9881acf91e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c711e2f-bd57-447f-8a78-09d30eaf08f9', 'volume_name': 'volume-0c711e2f-bd57-447f-8a78-09d30eaf08f9', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc0a232-7e58-42a4-ada7-61fec7a5ed2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc0a232-7e58-42a4-ada7-61fec7a5ed2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb335b9-fba0-4ca8-88de-332aab488046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:36 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Volume 0c711e2f-bd57-447f-8a78-09d30eaf08f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c711e2f-bd57-447f-8a78-09d30eaf08f9', 'volume_size': 1} Jun 30 16:13:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:13:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:13:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-882936367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c711e2f-bd57-447f-8a78-09d30eaf08f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf042eaa6bab455d986e74b152346ed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:13:37Z,use_quota=True,user_id='35432995d03c4993a8ebf61cd91919c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:13:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Creating volume 0c711e2f-bd57-447f-8a78-09d30eaf08f9 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:13:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:13:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:13:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:13:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:13:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:13:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:13:36 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:13:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0c711e2f-bd57-447f-8a78-09d30eaf08f9 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:36 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0c711e2f-bd57-447f-8a78-09d30eaf08f9 1073741824 Jun 30 16:13:36 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:37 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0c711e2f-bd57-447f-8a78-09d30eaf08f9 1073741824" returned: 0 in 0.871s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0c711e2f-bd57-447f-8a78-09d30eaf08f9 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:37 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0c711e2f-bd57-447f-8a78-09d30eaf08f9 Jun 30 16:13:37 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:38 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0c711e2f-bd57-447f-8a78-09d30eaf08f9" returned: 0 in 0.678s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:13:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:13:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb335b9-fba0-4ca8-88de-332aab488046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c711e2f-bd57-447f-8a78-09d30eaf08f9', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (206933b2-6e06-4545-9bf2-7f6da3da7242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:13:38 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Volume volume-0c711e2f-bd57-447f-8a78-09d30eaf08f9 (0c711e2f-bd57-447f-8a78-09d30eaf08f9): created successfully Jun 30 16:13:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (206933b2-6e06-4545-9bf2-7f6da3da7242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:13:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Flow 'volume_create_manager' (acbe384a-a96f-4ae8-a827-79a61c78b9d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:13:38 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-ae7f4974-cdba-4d1e-80e5-a926adfeba34 tempest-VolumesNegativeTest-468148826 None] Created volume successfully. Jun 30 16:13:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9b37136b-e1e8-45bd-985d-8afc8fb3b3fa tempest-VolumesActionsTest-828599955 None] Acquiring lock "cinder-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67" by "attach_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:13:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9b37136b-e1e8-45bd-985d-8afc8fb3b3fa tempest-VolumesActionsTest-828599955 None] Lock "cinder-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67" acquired by "attach_volume" :: waited 0.023s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:13:45 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:UPDATE=78,cinder:SELECT=83,cinder:INSERT=27,cinder:DELETE=7 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:13:45 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-9b37136b-e1e8-45bd-985d-8afc8fb3b3fa tempest-VolumesActionsTest-828599955 None] Attaching volume f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 to instance a651afae-dc81-458b-8ec9-a153e7613634 at mountpoint /dev/vdb on host None. Jun 30 16:13:45 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-9b37136b-e1e8-45bd-985d-8afc8fb3b3fa tempest-VolumesActionsTest-828599955 None] Attach volume completed successfully. Jun 30 16:13:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9b37136b-e1e8-45bd-985d-8afc8fb3b3fa tempest-VolumesActionsTest-828599955 None] Lock "cinder-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67" released by "attach_volume" :: held 0.181s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:13:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4a543f76-5819-40cf-96e2-834c05a6cb7d tempest-VolumesActionsTest-828599955 None] Acquiring lock "cinder-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67-detach_volume" by "detach_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:13:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4a543f76-5819-40cf-96e2-834c05a6cb7d tempest-VolumesActionsTest-828599955 None] Lock "cinder-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:13:45 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-4a543f76-5819-40cf-96e2-834c05a6cb7d tempest-VolumesActionsTest-828599955 None] Detaching volume f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 from instance a651afae-dc81-458b-8ec9-a153e7613634. Jun 30 16:13:46 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-4a543f76-5819-40cf-96e2-834c05a6cb7d tempest-VolumesActionsTest-828599955 None] Detach volume completed successfully. Jun 30 16:13:46 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4a543f76-5819-40cf-96e2-834c05a6cb7d tempest-VolumesActionsTest-828599955 None] Lock "cinder-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67-detach_volume" released by "detach_volume" :: held 0.119s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:13:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-bf6fa787-1627-4e67-9326-b6d3d49acf7f tempest-AttachVolumeTestJSON-1554772577 None] Acquiring lock "cinder-685989a9-8497-4ba3-8e88-a777d01c1026-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:13:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-bf6fa787-1627-4e67-9326-b6d3d49acf7f tempest-AttachVolumeTestJSON-1554772577 None] Lock "cinder-685989a9-8497-4ba3-8e88-a777d01c1026-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:13:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-bf6fa787-1627-4e67-9326-b6d3d49acf7f tempest-AttachVolumeTestJSON-1554772577 None] Acquiring lock "cinder-quobyte-685989a9-8497-4ba3-8e88-a777d01c1026" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:13:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-bf6fa787-1627-4e67-9326-b6d3d49acf7f tempest-AttachVolumeTestJSON-1554772577 None] Lock "cinder-quobyte-685989a9-8497-4ba3-8e88-a777d01c1026" acquired by "delete_volume" :: waited 0.015s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:13:50 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[235ae4f4-3cf8-4ea7-9575-705a640aab78]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:13:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bf6fa787-1627-4e67-9326-b6d3d49acf7f tempest-AttachVolumeTestJSON-1554772577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-685989a9-8497-4ba3-8e88-a777d01c1026 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:50 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-685989a9-8497-4ba3-8e88-a777d01c1026 Jun 30 16:13:50 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:51 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bf6fa787-1627-4e67-9326-b6d3d49acf7f tempest-AttachVolumeTestJSON-1554772577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-685989a9-8497-4ba3-8e88-a777d01c1026" returned: 0 in 0.842s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bf6fa787-1627-4e67-9326-b6d3d49acf7f tempest-AttachVolumeTestJSON-1554772577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-685989a9-8497-4ba3-8e88-a777d01c1026 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:51 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-685989a9-8497-4ba3-8e88-a777d01c1026 Jun 30 16:13:51 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:51 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bf6fa787-1627-4e67-9326-b6d3d49acf7f tempest-AttachVolumeTestJSON-1554772577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-685989a9-8497-4ba3-8e88-a777d01c1026" returned: 0 in 0.683s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:51 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-bf6fa787-1627-4e67-9326-b6d3d49acf7f tempest-AttachVolumeTestJSON-1554772577 None] Lock "cinder-quobyte-685989a9-8497-4ba3-8e88-a777d01c1026" released by "delete_volume" :: held 1.576s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:13:51 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-bf6fa787-1627-4e67-9326-b6d3d49acf7f tempest-AttachVolumeTestJSON-1554772577 None] Created reservations ['f29af33d-7fe1-4afb-82ae-994c169a4c6a', '30327fef-5be2-48f4-966c-5c7ed6a12a25', '54f17559-1bec-4617-ac96-b9006bffed3f', 'b886b2f2-019c-4adb-ad18-33464b1b4f16'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:13:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-bf6fa787-1627-4e67-9326-b6d3d49acf7f tempest-AttachVolumeTestJSON-1554772577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:13:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-bf6fa787-1627-4e67-9326-b6d3d49acf7f tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:13:51 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-bf6fa787-1627-4e67-9326-b6d3d49acf7f tempest-AttachVolumeTestJSON-1554772577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:13:51 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-bf6fa787-1627-4e67-9326-b6d3d49acf7f tempest-AttachVolumeTestJSON-1554772577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:13:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-bf6fa787-1627-4e67-9326-b6d3d49acf7f tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:13:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bf6fa787-1627-4e67-9326-b6d3d49acf7f tempest-AttachVolumeTestJSON-1554772577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:51 devstack sudo[103659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:13:51 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:52 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5fbdbcb2-99e7-4d08-8ecd-4a8e5df66d73 tempest-AttachVolumeTestJSON-1554772577 None] Acquiring lock "cinder-df631280-fb1a-456e-b6f7-6290ee5d3a11-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:13:52 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5fbdbcb2-99e7-4d08-8ecd-4a8e5df66d73 tempest-AttachVolumeTestJSON-1554772577 None] Lock "cinder-df631280-fb1a-456e-b6f7-6290ee5d3a11-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:13:52 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5fbdbcb2-99e7-4d08-8ecd-4a8e5df66d73 tempest-AttachVolumeTestJSON-1554772577 None] Acquiring lock "cinder-quobyte-df631280-fb1a-456e-b6f7-6290ee5d3a11" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:13:52 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5fbdbcb2-99e7-4d08-8ecd-4a8e5df66d73 tempest-AttachVolumeTestJSON-1554772577 None] Lock "cinder-quobyte-df631280-fb1a-456e-b6f7-6290ee5d3a11" acquired by "delete_volume" :: waited 0.024s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:13:52 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[3799e602-f16b-4fde-bf73-09f2f67cdcdb]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:13:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5fbdbcb2-99e7-4d08-8ecd-4a8e5df66d73 tempest-AttachVolumeTestJSON-1554772577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-df631280-fb1a-456e-b6f7-6290ee5d3a11 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:52 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bf6fa787-1627-4e67-9326-b6d3d49acf7f tempest-AttachVolumeTestJSON-1554772577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.841s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:52 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-bf6fa787-1627-4e67-9326-b6d3d49acf7f tempest-AttachVolumeTestJSON-1554772577 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:13:52 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-bf6fa787-1627-4e67-9326-b6d3d49acf7f tempest-AttachVolumeTestJSON-1554772577 None] Deleted volume successfully. Jun 30 16:13:52 devstack sudo[103666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-df631280-fb1a-456e-b6f7-6290ee5d3a11 Jun 30 16:13:52 devstack sudo[103666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:52 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-bf6fa787-1627-4e67-9326-b6d3d49acf7f tempest-AttachVolumeTestJSON-1554772577 None] Lock "cinder-685989a9-8497-4ba3-8e88-a777d01c1026-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:13:53 devstack sudo[103666]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5fbdbcb2-99e7-4d08-8ecd-4a8e5df66d73 tempest-AttachVolumeTestJSON-1554772577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-df631280-fb1a-456e-b6f7-6290ee5d3a11" returned: 0 in 1.022s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5fbdbcb2-99e7-4d08-8ecd-4a8e5df66d73 tempest-AttachVolumeTestJSON-1554772577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-df631280-fb1a-456e-b6f7-6290ee5d3a11 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:53 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-df631280-fb1a-456e-b6f7-6290ee5d3a11 Jun 30 16:13:53 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:54 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5fbdbcb2-99e7-4d08-8ecd-4a8e5df66d73 tempest-AttachVolumeTestJSON-1554772577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-df631280-fb1a-456e-b6f7-6290ee5d3a11" returned: 0 in 0.988s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5fbdbcb2-99e7-4d08-8ecd-4a8e5df66d73 tempest-AttachVolumeTestJSON-1554772577 None] Lock "cinder-quobyte-df631280-fb1a-456e-b6f7-6290ee5d3a11" released by "delete_volume" :: held 2.087s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:13:54 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-5fbdbcb2-99e7-4d08-8ecd-4a8e5df66d73 tempest-AttachVolumeTestJSON-1554772577 None] Created reservations ['5bd5c7ac-eef2-4bbe-baf4-490eea110153', 'aaa0c633-bc3f-4741-b287-c282db8044f9', '5fed37ca-4a57-450d-8b23-b60076f2c232', '1af3a9c8-5ab7-4861-92f3-b8305208e628'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:13:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5fbdbcb2-99e7-4d08-8ecd-4a8e5df66d73 tempest-AttachVolumeTestJSON-1554772577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:13:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5fbdbcb2-99e7-4d08-8ecd-4a8e5df66d73 tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:13:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5fbdbcb2-99e7-4d08-8ecd-4a8e5df66d73 tempest-AttachVolumeTestJSON-1554772577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:13:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5fbdbcb2-99e7-4d08-8ecd-4a8e5df66d73 tempest-AttachVolumeTestJSON-1554772577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:13:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5fbdbcb2-99e7-4d08-8ecd-4a8e5df66d73 tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:13:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5fbdbcb2-99e7-4d08-8ecd-4a8e5df66d73 tempest-AttachVolumeTestJSON-1554772577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:54 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:13:54 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cfb485f2-f872-400f-897b-c426073e08af tempest-AttachVolumeTestJSON-1554772577 None] Acquiring lock "cinder-825deee8-8c26-439a-8466-1a41a8035c99-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:13:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cfb485f2-f872-400f-897b-c426073e08af tempest-AttachVolumeTestJSON-1554772577 None] Lock "cinder-825deee8-8c26-439a-8466-1a41a8035c99-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:13:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cfb485f2-f872-400f-897b-c426073e08af tempest-AttachVolumeTestJSON-1554772577 None] Acquiring lock "cinder-quobyte-825deee8-8c26-439a-8466-1a41a8035c99" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:13:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cfb485f2-f872-400f-897b-c426073e08af tempest-AttachVolumeTestJSON-1554772577 None] Lock "cinder-quobyte-825deee8-8c26-439a-8466-1a41a8035c99" acquired by "delete_volume" :: waited 0.021s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:13:56 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a26d782-0b9a-4351-9c20-93540bce9e09]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:13:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cfb485f2-f872-400f-897b-c426073e08af tempest-AttachVolumeTestJSON-1554772577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-825deee8-8c26-439a-8466-1a41a8035c99 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:56 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5fbdbcb2-99e7-4d08-8ecd-4a8e5df66d73 tempest-AttachVolumeTestJSON-1554772577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.501s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:56 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-5fbdbcb2-99e7-4d08-8ecd-4a8e5df66d73 tempest-AttachVolumeTestJSON-1554772577 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:13:56 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-5fbdbcb2-99e7-4d08-8ecd-4a8e5df66d73 tempest-AttachVolumeTestJSON-1554772577 None] Deleted volume successfully. Jun 30 16:13:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5fbdbcb2-99e7-4d08-8ecd-4a8e5df66d73 tempest-AttachVolumeTestJSON-1554772577 None] Lock "cinder-df631280-fb1a-456e-b6f7-6290ee5d3a11-delete_volume" released by "delete_volume" :: held 3.996s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:13:56 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-825deee8-8c26-439a-8466-1a41a8035c99 Jun 30 16:13:56 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:57 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cfb485f2-f872-400f-897b-c426073e08af tempest-AttachVolumeTestJSON-1554772577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-825deee8-8c26-439a-8466-1a41a8035c99" returned: 0 in 0.968s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cfb485f2-f872-400f-897b-c426073e08af tempest-AttachVolumeTestJSON-1554772577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-825deee8-8c26-439a-8466-1a41a8035c99 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:57 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-825deee8-8c26-439a-8466-1a41a8035c99 Jun 30 16:13:57 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:58 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cfb485f2-f872-400f-897b-c426073e08af tempest-AttachVolumeTestJSON-1554772577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-825deee8-8c26-439a-8466-1a41a8035c99" returned: 0 in 0.728s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:58 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cfb485f2-f872-400f-897b-c426073e08af tempest-AttachVolumeTestJSON-1554772577 None] Lock "cinder-quobyte-825deee8-8c26-439a-8466-1a41a8035c99" released by "delete_volume" :: held 1.747s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:13:58 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-cfb485f2-f872-400f-897b-c426073e08af tempest-AttachVolumeTestJSON-1554772577 None] Created reservations ['fbe2f5f0-a892-462c-af46-214f6223616d', 'e438c788-3dee-4fa0-8b3d-2d26cecc0f33', '742b3981-3164-42e7-bf95-5deb8d3209c2', 'f49c72cf-32b3-49a5-a3da-0d218d9fb6d3'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:13:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cfb485f2-f872-400f-897b-c426073e08af tempest-AttachVolumeTestJSON-1554772577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:13:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cfb485f2-f872-400f-897b-c426073e08af tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:13:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cfb485f2-f872-400f-897b-c426073e08af tempest-AttachVolumeTestJSON-1554772577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:13:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cfb485f2-f872-400f-897b-c426073e08af tempest-AttachVolumeTestJSON-1554772577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:13:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cfb485f2-f872-400f-897b-c426073e08af tempest-AttachVolumeTestJSON-1554772577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:13:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cfb485f2-f872-400f-897b-c426073e08af tempest-AttachVolumeTestJSON-1554772577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:13:58 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:13:58 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:13:59 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Jun 30 16:13:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cfb485f2-f872-400f-897b-c426073e08af tempest-AttachVolumeTestJSON-1554772577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.845s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:13:59 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-cfb485f2-f872-400f-897b-c426073e08af tempest-AttachVolumeTestJSON-1554772577 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:13:59 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-cfb485f2-f872-400f-897b-c426073e08af tempest-AttachVolumeTestJSON-1554772577 None] Deleted volume successfully. Jun 30 16:13:59 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cfb485f2-f872-400f-897b-c426073e08af tempest-AttachVolumeTestJSON-1554772577 None] Lock "cinder-825deee8-8c26-439a-8466-1a41a8035c99-delete_volume" released by "delete_volume" :: held 2.905s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:13:59 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-356b4b35-3150-4a17-b609-1e62dc5680ac req-4a1d6222-765a-47ac-a9c5-97ed43b33464 tempest-AttachVolumeNegativeTest-2129882576 None] Terminate volume connection completed successfully. Jun 30 16:13:59 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-356b4b35-3150-4a17-b609-1e62dc5680ac req-4a1d6222-765a-47ac-a9c5-97ed43b33464 tempest-AttachVolumeNegativeTest-2129882576 None] Deleting attachment 304fd0d9-0599-463f-86e5-ec90b4b86194. {{(pid=93781) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 30 16:14:08 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:UPDATE=67,cinder:SELECT=57,cinder:INSERT=21,cinder:DELETE=7 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:14:08 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:14:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Flow 'volume_create_manager' (44a83586-3c70-4ca7-a3f0-69370c822794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:14:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a168f21-97a3-43a8-8052-d48fc3eb6c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a168f21-97a3-43a8-8052-d48fc3eb6c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1615349087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae87b42-707d-4ff6-9002-c505803794eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c96e8647071f4eb190d5b84c2e551b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:14:08Z,use_quota=True,user_id='bf6f57aa39f24ee0877012166cbf3d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce5775d-daa7-49f5-bae3-143e4f12c7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce5775d-daa7-49f5-bae3-143e4f12c7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d84291e-2976-4a7a-8d6f-5c6d906e6ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d84291e-2976-4a7a-8d6f-5c6d906e6ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ae87b42-707d-4ff6-9002-c505803794eb', 'volume_name': 'volume-5ae87b42-707d-4ff6-9002-c505803794eb', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9af39e-f95e-4bf6-9591-aaaf2604979b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9af39e-f95e-4bf6-9591-aaaf2604979b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c235eaf0-22f2-411a-b8d8-f9387ade91ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:08 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Volume 5ae87b42-707d-4ff6-9002-c505803794eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ae87b42-707d-4ff6-9002-c505803794eb', 'volume_size': 1} Jun 30 16:14:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:14:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:14:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1615349087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae87b42-707d-4ff6-9002-c505803794eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c96e8647071f4eb190d5b84c2e551b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:14:08Z,use_quota=True,user_id='bf6f57aa39f24ee0877012166cbf3d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:14:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Creating volume 5ae87b42-707d-4ff6-9002-c505803794eb {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:14:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:14:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:14:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:14:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:14:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:14:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:14:08 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:14:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5ae87b42-707d-4ff6-9002-c505803794eb 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:08 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5ae87b42-707d-4ff6-9002-c505803794eb 1073741824 Jun 30 16:14:08 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:14:09 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Jun 30 16:14:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5ae87b42-707d-4ff6-9002-c505803794eb 1073741824" returned: 0 in 0.983s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:14:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5ae87b42-707d-4ff6-9002-c505803794eb {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:09 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5ae87b42-707d-4ff6-9002-c505803794eb Jun 30 16:14:09 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:14:10 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Jun 30 16:14:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5ae87b42-707d-4ff6-9002-c505803794eb" returned: 0 in 1.284s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:14:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] <== create_volume: return (2342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:14:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.344s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:14:11 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c235eaf0-22f2-411a-b8d8-f9387ade91ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ae87b42-707d-4ff6-9002-c505803794eb', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:11 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa36ecc7-2aa1-4fd4-a2f7-5decff1b7497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:11 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Volume volume-5ae87b42-707d-4ff6-9002-c505803794eb (5ae87b42-707d-4ff6-9002-c505803794eb): created successfully Jun 30 16:14:11 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa36ecc7-2aa1-4fd4-a2f7-5decff1b7497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:11 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Flow 'volume_create_manager' (44a83586-3c70-4ca7-a3f0-69370c822794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:14:11 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-95b4d554-77e3-4c21-8341-18a3fd6dce78 req-7c33fb90-82b0-492a-aca4-e55a9f9d909e tempest-VolumesGetTestJSON-1509340099 None] Created volume successfully. Jun 30 16:14:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-9986d6bb-39dc-4d3f-8889-1f24e993c80e req-cfe07ae4-f377-4f8a-a294-fa91e4af31a3 tempest-VolumesGetTestJSON-1509340099 None] Acquiring lock "cinder-5ae87b42-707d-4ff6-9002-c505803794eb-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:14:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-9986d6bb-39dc-4d3f-8889-1f24e993c80e req-cfe07ae4-f377-4f8a-a294-fa91e4af31a3 tempest-VolumesGetTestJSON-1509340099 None] Lock "cinder-5ae87b42-707d-4ff6-9002-c505803794eb-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:14:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-9986d6bb-39dc-4d3f-8889-1f24e993c80e req-cfe07ae4-f377-4f8a-a294-fa91e4af31a3 tempest-VolumesGetTestJSON-1509340099 None] Acquiring lock "cinder-quobyte-5ae87b42-707d-4ff6-9002-c505803794eb" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:14:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-9986d6bb-39dc-4d3f-8889-1f24e993c80e req-cfe07ae4-f377-4f8a-a294-fa91e4af31a3 tempest-VolumesGetTestJSON-1509340099 None] Lock "cinder-quobyte-5ae87b42-707d-4ff6-9002-c505803794eb" acquired by "delete_volume" :: waited 0.030s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:14:12 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3eccd6d-0bf3-49c2-8db8-48bd110ee617]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:14:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-9986d6bb-39dc-4d3f-8889-1f24e993c80e req-cfe07ae4-f377-4f8a-a294-fa91e4af31a3 tempest-VolumesGetTestJSON-1509340099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5ae87b42-707d-4ff6-9002-c505803794eb {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:12 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5ae87b42-707d-4ff6-9002-c505803794eb Jun 30 16:14:12 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:14:13 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-aea243e2-48fb-41e5-8de4-04244c789f9a tempest-VolumesActionsTest-828599955 None] Acquiring lock "cinder-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67" by "attach_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:14:13 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-aea243e2-48fb-41e5-8de4-04244c789f9a tempest-VolumesActionsTest-828599955 None] Lock "cinder-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67" acquired by "attach_volume" :: waited 0.025s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:14:13 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-aea243e2-48fb-41e5-8de4-04244c789f9a tempest-VolumesActionsTest-828599955 None] Attaching volume f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 to instance 2e03ec88-4def-4096-b5b3-4ef6619bddd2 at mountpoint /dev/vdb on host None. Jun 30 16:14:13 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-aea243e2-48fb-41e5-8de4-04244c789f9a tempest-VolumesActionsTest-828599955 None] Attach volume completed successfully. Jun 30 16:14:13 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-aea243e2-48fb-41e5-8de4-04244c789f9a tempest-VolumesActionsTest-828599955 None] Lock "cinder-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67" released by "attach_volume" :: held 0.216s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:14:14 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Jun 30 16:14:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-9986d6bb-39dc-4d3f-8889-1f24e993c80e req-cfe07ae4-f377-4f8a-a294-fa91e4af31a3 tempest-VolumesGetTestJSON-1509340099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5ae87b42-707d-4ff6-9002-c505803794eb" returned: 0 in 1.402s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:14:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-9986d6bb-39dc-4d3f-8889-1f24e993c80e req-cfe07ae4-f377-4f8a-a294-fa91e4af31a3 tempest-VolumesGetTestJSON-1509340099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5ae87b42-707d-4ff6-9002-c505803794eb {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:14 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5ae87b42-707d-4ff6-9002-c505803794eb Jun 30 16:14:14 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:14:14 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-750145d3-f1bb-466d-a9bd-871d3c9fd565 tempest-VolumesActionsTest-828599955 None] Acquiring lock "cinder-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67-detach_volume" by "detach_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:14:14 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-750145d3-f1bb-466d-a9bd-871d3c9fd565 tempest-VolumesActionsTest-828599955 None] Lock "cinder-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:14:14 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-750145d3-f1bb-466d-a9bd-871d3c9fd565 tempest-VolumesActionsTest-828599955 None] Detaching volume f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 from instance 2e03ec88-4def-4096-b5b3-4ef6619bddd2. Jun 30 16:14:14 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-750145d3-f1bb-466d-a9bd-871d3c9fd565 tempest-VolumesActionsTest-828599955 None] Detach volume completed successfully. Jun 30 16:14:14 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-750145d3-f1bb-466d-a9bd-871d3c9fd565 tempest-VolumesActionsTest-828599955 None] Lock "cinder-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67-detach_volume" released by "detach_volume" :: held 0.169s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:14:14 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Jun 30 16:14:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-9986d6bb-39dc-4d3f-8889-1f24e993c80e req-cfe07ae4-f377-4f8a-a294-fa91e4af31a3 tempest-VolumesGetTestJSON-1509340099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5ae87b42-707d-4ff6-9002-c505803794eb" returned: 0 in 0.769s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:14:14 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-9986d6bb-39dc-4d3f-8889-1f24e993c80e req-cfe07ae4-f377-4f8a-a294-fa91e4af31a3 tempest-VolumesGetTestJSON-1509340099 None] Lock "cinder-quobyte-5ae87b42-707d-4ff6-9002-c505803794eb" released by "delete_volume" :: held 2.256s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:14:14 devstack cinder-volume[93781]: DEBUG cinder.quota [req-9986d6bb-39dc-4d3f-8889-1f24e993c80e req-cfe07ae4-f377-4f8a-a294-fa91e4af31a3 tempest-VolumesGetTestJSON-1509340099 None] Created reservations ['49a71b73-a30a-4180-8099-beee0041635c', '07e1396c-29d0-4e67-82ef-c4e16286d1b8', 'fd9fed70-d161-4eee-9a1f-96e773df037e', '33413e32-176e-4a4f-aa68-d14373ebfc46'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:14:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-9986d6bb-39dc-4d3f-8889-1f24e993c80e req-cfe07ae4-f377-4f8a-a294-fa91e4af31a3 tempest-VolumesGetTestJSON-1509340099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:14:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-9986d6bb-39dc-4d3f-8889-1f24e993c80e req-cfe07ae4-f377-4f8a-a294-fa91e4af31a3 tempest-VolumesGetTestJSON-1509340099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:14:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [req-9986d6bb-39dc-4d3f-8889-1f24e993c80e req-cfe07ae4-f377-4f8a-a294-fa91e4af31a3 tempest-VolumesGetTestJSON-1509340099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:14:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [req-9986d6bb-39dc-4d3f-8889-1f24e993c80e req-cfe07ae4-f377-4f8a-a294-fa91e4af31a3 tempest-VolumesGetTestJSON-1509340099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:14:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-9986d6bb-39dc-4d3f-8889-1f24e993c80e req-cfe07ae4-f377-4f8a-a294-fa91e4af31a3 tempest-VolumesGetTestJSON-1509340099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:14:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-9986d6bb-39dc-4d3f-8889-1f24e993c80e req-cfe07ae4-f377-4f8a-a294-fa91e4af31a3 tempest-VolumesGetTestJSON-1509340099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:15 devstack sudo[104037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:14:15 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:14:16 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root Jun 30 16:14:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-9986d6bb-39dc-4d3f-8889-1f24e993c80e req-cfe07ae4-f377-4f8a-a294-fa91e4af31a3 tempest-VolumesGetTestJSON-1509340099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.287s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:14:16 devstack cinder-volume[93781]: DEBUG cinder.manager [req-9986d6bb-39dc-4d3f-8889-1f24e993c80e req-cfe07ae4-f377-4f8a-a294-fa91e4af31a3 tempest-VolumesGetTestJSON-1509340099 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:14:16 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-9986d6bb-39dc-4d3f-8889-1f24e993c80e req-cfe07ae4-f377-4f8a-a294-fa91e4af31a3 tempest-VolumesGetTestJSON-1509340099 None] Deleted volume successfully. Jun 30 16:14:16 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-9986d6bb-39dc-4d3f-8889-1f24e993c80e req-cfe07ae4-f377-4f8a-a294-fa91e4af31a3 tempest-VolumesGetTestJSON-1509340099 None] Lock "cinder-5ae87b42-707d-4ff6-9002-c505803794eb-delete_volume" released by "delete_volume" :: held 4.005s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:14:18 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e0d55f7a-2f93-48ac-80bd-f247f6188ab8 tempest-VolumesNegativeTest-468148826 None] Acquiring lock "cinder-0c711e2f-bd57-447f-8a78-09d30eaf08f9-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:14:18 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e0d55f7a-2f93-48ac-80bd-f247f6188ab8 tempest-VolumesNegativeTest-468148826 None] Lock "cinder-0c711e2f-bd57-447f-8a78-09d30eaf08f9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:14:18 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e0d55f7a-2f93-48ac-80bd-f247f6188ab8 tempest-VolumesNegativeTest-468148826 None] Acquiring lock "cinder-quobyte-0c711e2f-bd57-447f-8a78-09d30eaf08f9" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:14:18 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e0d55f7a-2f93-48ac-80bd-f247f6188ab8 tempest-VolumesNegativeTest-468148826 None] Lock "cinder-quobyte-0c711e2f-bd57-447f-8a78-09d30eaf08f9" acquired by "delete_volume" :: waited 0.020s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:14:18 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55ddd41-503e-4e69-8338-a2402ac910b7]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:14:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e0d55f7a-2f93-48ac-80bd-f247f6188ab8 tempest-VolumesNegativeTest-468148826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0c711e2f-bd57-447f-8a78-09d30eaf08f9 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:18 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0c711e2f-bd57-447f-8a78-09d30eaf08f9 Jun 30 16:14:18 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:14:19 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Jun 30 16:14:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e0d55f7a-2f93-48ac-80bd-f247f6188ab8 tempest-VolumesNegativeTest-468148826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0c711e2f-bd57-447f-8a78-09d30eaf08f9" returned: 0 in 0.935s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:14:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e0d55f7a-2f93-48ac-80bd-f247f6188ab8 tempest-VolumesNegativeTest-468148826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0c711e2f-bd57-447f-8a78-09d30eaf08f9 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:19 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0c711e2f-bd57-447f-8a78-09d30eaf08f9 Jun 30 16:14:19 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:14:20 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Jun 30 16:14:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e0d55f7a-2f93-48ac-80bd-f247f6188ab8 tempest-VolumesNegativeTest-468148826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0c711e2f-bd57-447f-8a78-09d30eaf08f9" returned: 0 in 0.701s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:14:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e0d55f7a-2f93-48ac-80bd-f247f6188ab8 tempest-VolumesNegativeTest-468148826 None] Lock "cinder-quobyte-0c711e2f-bd57-447f-8a78-09d30eaf08f9" released by "delete_volume" :: held 1.709s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:14:20 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-e0d55f7a-2f93-48ac-80bd-f247f6188ab8 tempest-VolumesNegativeTest-468148826 None] Created reservations ['6cf9a7d1-e817-4098-8dc6-224a8a51d7aa', '0473d85a-a485-4656-952d-906404e4c964', '2eba776a-f7e2-4d86-8ecf-3a6ead16a089', '98beaea3-a5f8-434f-ae7e-6f0eb2214450'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:14:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e0d55f7a-2f93-48ac-80bd-f247f6188ab8 tempest-VolumesNegativeTest-468148826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:14:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e0d55f7a-2f93-48ac-80bd-f247f6188ab8 tempest-VolumesNegativeTest-468148826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:14:20 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e0d55f7a-2f93-48ac-80bd-f247f6188ab8 tempest-VolumesNegativeTest-468148826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:14:20 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e0d55f7a-2f93-48ac-80bd-f247f6188ab8 tempest-VolumesNegativeTest-468148826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:14:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e0d55f7a-2f93-48ac-80bd-f247f6188ab8 tempest-VolumesNegativeTest-468148826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:14:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e0d55f7a-2f93-48ac-80bd-f247f6188ab8 tempest-VolumesNegativeTest-468148826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:20 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:14:20 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:14:20 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Jun 30 16:14:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e0d55f7a-2f93-48ac-80bd-f247f6188ab8 tempest-VolumesNegativeTest-468148826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.673s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:14:20 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-e0d55f7a-2f93-48ac-80bd-f247f6188ab8 tempest-VolumesNegativeTest-468148826 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:14:20 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-e0d55f7a-2f93-48ac-80bd-f247f6188ab8 tempest-VolumesNegativeTest-468148826 None] Deleted volume successfully. Jun 30 16:14:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e0d55f7a-2f93-48ac-80bd-f247f6188ab8 tempest-VolumesNegativeTest-468148826 None] Lock "cinder-0c711e2f-bd57-447f-8a78-09d30eaf08f9-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:14:21 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:14:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Flow 'volume_create_manager' (1a000303-0914-428b-b1db-d88611994736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:14:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a052482d-04c1-42eb-b079-2dba0120feb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a052482d-04c1-42eb-b079-2dba0120feb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-422722894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6f664a0-73e7-482a-ac4b-2f43bd177c29,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8ddf5bcfe32f4f3bb1fcebacf41f90e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:14:21Z,use_quota=True,user_id='56561341fd35463d957378f068eabcb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd3ae81-57d0-4b81-ad57-38be647165f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd3ae81-57d0-4b81-ad57-38be647165f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef1d5a28-3e5c-4ab4-8390-c9037661f520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef1d5a28-3e5c-4ab4-8390-c9037661f520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6f664a0-73e7-482a-ac4b-2f43bd177c29', 'volume_name': 'volume-f6f664a0-73e7-482a-ac4b-2f43bd177c29', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7714b768-b4d4-44eb-acae-79543fb51e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7714b768-b4d4-44eb-acae-79543fb51e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d808bf-745c-4387-b443-39bcf2ee31e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:21 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Volume f6f664a0-73e7-482a-ac4b-2f43bd177c29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6f664a0-73e7-482a-ac4b-2f43bd177c29', 'volume_size': 1} Jun 30 16:14:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:14:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:14:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-422722894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6f664a0-73e7-482a-ac4b-2f43bd177c29,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8ddf5bcfe32f4f3bb1fcebacf41f90e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:14:21Z,use_quota=True,user_id='56561341fd35463d957378f068eabcb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:14:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Creating volume f6f664a0-73e7-482a-ac4b-2f43bd177c29 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:14:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:14:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:14:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:14:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:14:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:14:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:14:21 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:14:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f664a0-73e7-482a-ac4b-2f43bd177c29 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:21 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f664a0-73e7-482a-ac4b-2f43bd177c29 1073741824 Jun 30 16:14:21 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:14:22 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Jun 30 16:14:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f664a0-73e7-482a-ac4b-2f43bd177c29 1073741824" returned: 0 in 1.081s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:14:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f664a0-73e7-482a-ac4b-2f43bd177c29 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:22 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f664a0-73e7-482a-ac4b-2f43bd177c29 Jun 30 16:14:22 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:14:23 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f664a0-73e7-482a-ac4b-2f43bd177c29" returned: 0 in 0.824s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] <== create_volume: return (1965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d808bf-745c-4387-b443-39bcf2ee31e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6f664a0-73e7-482a-ac4b-2f43bd177c29', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4485c4e0-fada-43a3-b8fd-dce513fe34ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:23 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Volume volume-f6f664a0-73e7-482a-ac4b-2f43bd177c29 (f6f664a0-73e7-482a-ac4b-2f43bd177c29): created successfully Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4485c4e0-fada-43a3-b8fd-dce513fe34ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Flow 'volume_create_manager' (1a000303-0914-428b-b1db-d88611994736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:14:23 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-1a4c75b2-7e4a-4400-a79c-c2ad7de57f78 tempest-VolumesTestJSON-786994339 None] Created volume successfully. Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Flow 'volume_create_manager' (2762d99b-8177-40bf-8971-c70b5729a35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aad34c1-eb3e-4331-a853-800d5ddebd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aad34c1-eb3e-4331-a853-800d5ddebd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-567847988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=384d3cd4-0824-4437-89e1-58dbd06c7b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a073a22807ea4e1ea1e97449c6baca95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:14:24Z,use_quota=True,user_id='0473214dd260419680c1c65767d01b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94cad6db-66b2-462e-b519-c515d9a86471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94cad6db-66b2-462e-b519-c515d9a86471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7c44ad-246f-44ff-94b6-d6dd3837f5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7c44ad-246f-44ff-94b6-d6dd3837f5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '384d3cd4-0824-4437-89e1-58dbd06c7b15', 'volume_name': 'volume-384d3cd4-0824-4437-89e1-58dbd06c7b15', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb162fe-d423-4be1-931c-546d3c359904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb162fe-d423-4be1-931c-546d3c359904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164c585b-321c-4a4f-bc04-14d3256815a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:23 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Volume 384d3cd4-0824-4437-89e1-58dbd06c7b15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-384d3cd4-0824-4437-89e1-58dbd06c7b15', 'volume_size': 1} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-567847988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=384d3cd4-0824-4437-89e1-58dbd06c7b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a073a22807ea4e1ea1e97449c6baca95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:14:24Z,use_quota=True,user_id='0473214dd260419680c1c65767d01b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Creating volume 384d3cd4-0824-4437-89e1-58dbd06c7b15 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:14:23 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:14:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:23 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15 1073741824 Jun 30 16:14:23 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:14:25 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15 1073741824" returned: 0 in 1.328s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:25 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15 Jun 30 16:14:25 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Flow 'volume_create_manager' (ebf52893-4d09-4b4a-812c-e596ad1616e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb3188a-b02e-4665-a1a7-671b7df0377a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb3188a-b02e-4665-a1a7-671b7df0377a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-230260395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2f9b0c-283f-44fb-8510-1d75c31a2a26,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8ddf5bcfe32f4f3bb1fcebacf41f90e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:14:25Z,use_quota=True,user_id='56561341fd35463d957378f068eabcb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b8b8dc-6061-410d-ad9a-e0d2c24763a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b8b8dc-6061-410d-ad9a-e0d2c24763a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50442649-2dd3-4151-a3c0-dd7f203f4018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50442649-2dd3-4151-a3c0-dd7f203f4018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f2f9b0c-283f-44fb-8510-1d75c31a2a26', 'volume_name': 'volume-7f2f9b0c-283f-44fb-8510-1d75c31a2a26', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137d547c-a7f4-4e89-9adf-13b4648451f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137d547c-a7f4-4e89-9adf-13b4648451f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205f5544-2529-43c7-889d-b4e23385068b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:25 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Volume 7f2f9b0c-283f-44fb-8510-1d75c31a2a26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f2f9b0c-283f-44fb-8510-1d75c31a2a26', 'volume_size': 1} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-04db8724-c57e-485d-8adb-6a2871b8f548 tempest-VolumesActionsTest-828599955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:14:25 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15" returned: 0 in 0.703s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.092s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.461s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-230260395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2f9b0c-283f-44fb-8510-1d75c31a2a26,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8ddf5bcfe32f4f3bb1fcebacf41f90e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:14:25Z,use_quota=True,user_id='56561341fd35463d957378f068eabcb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Creating volume 7f2f9b0c-283f-44fb-8510-1d75c31a2a26 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:14:25 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7f2f9b0c-283f-44fb-8510-1d75c31a2a26 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164c585b-321c-4a4f-bc04-14d3256815a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-384d3cd4-0824-4437-89e1-58dbd06c7b15', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:25 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7f2f9b0c-283f-44fb-8510-1d75c31a2a26 1073741824 Jun 30 16:14:25 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:14:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e264ffc-c4d5-4e6c-a0eb-3e70b615c4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:26 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Volume volume-384d3cd4-0824-4437-89e1-58dbd06c7b15 (384d3cd4-0824-4437-89e1-58dbd06c7b15): created successfully Jun 30 16:14:26 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e264ffc-c4d5-4e6c-a0eb-3e70b615c4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:26 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Flow 'volume_create_manager' (2762d99b-8177-40bf-8971-c70b5729a35b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:14:26 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-270c6d73-8895-4d07-a308-0dcd8eec80de tempest-VolumesSnapshotListTestJSON-1665070985 None] Created volume successfully. Jun 30 16:14:26 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Jun 30 16:14:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7f2f9b0c-283f-44fb-8510-1d75c31a2a26 1073741824" returned: 0 in 0.926s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:14:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7f2f9b0c-283f-44fb-8510-1d75c31a2a26 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:26 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7f2f9b0c-283f-44fb-8510-1d75c31a2a26 Jun 30 16:14:26 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:14:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-60fcc7d8-c9ef-4567-b6c3-74040212fce1 tempest-VolumesSnapshotListTestJSON-1665070985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:14:27 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Jun 30 16:14:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7f2f9b0c-283f-44fb-8510-1d75c31a2a26" returned: 0 in 0.669s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:14:27 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:14:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:14:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-04db8724-c57e-485d-8adb-6a2871b8f548 tempest-VolumesActionsTest-828599955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:14:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205f5544-2529-43c7-889d-b4e23385068b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f2f9b0c-283f-44fb-8510-1d75c31a2a26', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d541c7-2a6c-45b9-a93d-15c65eddf1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:27 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e898be-0c07-424e-ad02-e0fd6d97ec7e]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:14:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-04db8724-c57e-485d-8adb-6a2871b8f548 tempest-VolumesActionsTest-828599955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:27 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Volume volume-7f2f9b0c-283f-44fb-8510-1d75c31a2a26 (7f2f9b0c-283f-44fb-8510-1d75c31a2a26): created successfully Jun 30 16:14:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d541c7-2a6c-45b9-a93d-15c65eddf1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Flow 'volume_create_manager' (ebf52893-4d09-4b4a-812c-e596ad1616e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:14:27 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-6913d921-2c75-4987-a51b-e247e9ce10c5 tempest-VolumesTestJSON-786994339 None] Created volume successfully. Jun 30 16:14:27 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 Jun 30 16:14:27 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:14:28 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Jun 30 16:14:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-04db8724-c57e-485d-8adb-6a2871b8f548 tempest-VolumesActionsTest-828599955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67" returned: 0 in 0.756s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:14:28 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1cdf01-1079-43ee-8b8e-b6a75ce44a8c]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:14:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-04db8724-c57e-485d-8adb-6a2871b8f548 tempest-VolumesActionsTest-828599955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:28 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 Jun 30 16:14:28 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:14:28 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:14:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Flow 'volume_create_manager' (fbc851e2-aba5-4acd-bf73-9a9808d4102a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:14:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a190fcf7-cf31-4910-af0a-e88699afc1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a190fcf7-cf31-4910-af0a-e88699afc1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-87671596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d4eb1c-602a-4f55-b680-8534fa02c533,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8ddf5bcfe32f4f3bb1fcebacf41f90e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:14:29Z,use_quota=True,user_id='56561341fd35463d957378f068eabcb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e27e14-8d74-41d4-a3d8-7144169a2006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e27e14-8d74-41d4-a3d8-7144169a2006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45218208-2f22-433b-af4f-5a73057407d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45218208-2f22-433b-af4f-5a73057407d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17d4eb1c-602a-4f55-b680-8534fa02c533', 'volume_name': 'volume-17d4eb1c-602a-4f55-b680-8534fa02c533', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70fa87fe-9780-4cdf-b40f-b369fa780901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70fa87fe-9780-4cdf-b40f-b369fa780901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d2ab82-a6bc-4030-9bf4-5d9004e3b7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:29 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Volume 17d4eb1c-602a-4f55-b680-8534fa02c533: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17d4eb1c-602a-4f55-b680-8534fa02c533', 'volume_size': 1} Jun 30 16:14:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:14:29 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Jun 30 16:14:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-04db8724-c57e-485d-8adb-6a2871b8f548 tempest-VolumesActionsTest-828599955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67" returned: 0 in 0.819s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:14:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-04db8724-c57e-485d-8adb-6a2871b8f548 tempest-VolumesActionsTest-828599955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 /opt/stack/data/cinder/conversion/f44ba4ac-5773-4ad1-861b-ee6d1ae66a67.temp_image.034ac43f-977e-47d0-94b0-b4d28bd87640lvl8df41.img {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:29 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 /opt/stack/data/cinder/conversion/f44ba4ac-5773-4ad1-861b-ee6d1ae66a67.temp_image.034ac43f-977e-47d0-94b0-b4d28bd87640lvl8df41.img Jun 30 16:14:29 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:14:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:14:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:14:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:14:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:14:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:14:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:14:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:33 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:14:33 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:14:35 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Jun 30 16:14:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.941s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:14:35 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:14:35 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:14:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 28 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:14:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:14:36 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Jun 30 16:14:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-04db8724-c57e-485d-8adb-6a2871b8f548 tempest-VolumesActionsTest-828599955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 /opt/stack/data/cinder/conversion/f44ba4ac-5773-4ad1-861b-ee6d1ae66a67.temp_image.034ac43f-977e-47d0-94b0-b4d28bd87640lvl8df41.img" returned: 0 in 6.880s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:14:36 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03b7cef-cc6b-441b-9ff6-5ca52db6adde]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:14:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-04db8724-c57e-485d-8adb-6a2871b8f548 tempest-VolumesActionsTest-828599955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:36 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 Jun 30 16:14:36 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:14:37 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Jun 30 16:14:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-04db8724-c57e-485d-8adb-6a2871b8f548 tempest-VolumesActionsTest-828599955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67" returned: 0 in 1.030s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:14:37 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-04db8724-c57e-485d-8adb-6a2871b8f548 tempest-VolumesActionsTest-828599955 None] Image conversion details: src /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67, size 1024.00 MB, duration 6.88 sec, destination /opt/stack/data/cinder/conversion/f44ba4ac-5773-4ad1-861b-ee6d1ae66a67.temp_image.034ac43f-977e-47d0-94b0-b4d28bd87640lvl8df41.img {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:14:37 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-04db8724-c57e-485d-8adb-6a2871b8f548 tempest-VolumesActionsTest-828599955 None] Converted 1024.00 MB image at 148.82 MB/s Jun 30 16:14:37 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-04db8724-c57e-485d-8adb-6a2871b8f548 tempest-VolumesActionsTest-828599955 None] 034ac43f-977e-47d0-94b0-b4d28bd87640 was raw, no need to convert to raw {{(pid=93781) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 30 16:14:44 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=50,cinder:INSERT=9,cinder:UPDATE=60,cinder:DELETE=3 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:14:47 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:UPDATE=29,cinder:SELECT=29,cinder:INSERT=12,cinder:DELETE=3 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:14:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-04db8724-c57e-485d-8adb-6a2871b8f548 tempest-VolumesActionsTest-828599955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.288s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:14:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-04db8724-c57e-485d-8adb-6a2871b8f548 tempest-VolumesActionsTest-828599955 None] Uploaded volume to glance image-id: 034ac43f-977e-47d0-94b0-b4d28bd87640. {{(pid=93781) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 30 16:14:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-60fcc7d8-c9ef-4567-b6c3-74040212fce1 tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 29.908s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:14:56 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-60fcc7d8-c9ef-4567-b6c3-74040212fce1 tempest-VolumesSnapshotListTestJSON-1665070985 None] Creating offline snapshot 9ea2e277-fd7c-4309-92e2-818c49497d69 of volume 384d3cd4-0824-4437-89e1-58dbd06c7b15 {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:14:56 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-04db8724-c57e-485d-8adb-6a2871b8f548 tempest-VolumesActionsTest-828599955 None] Copy volume to image completed successfully. Jun 30 16:14:56 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a96b6da-7f78-41b3-b014-62762afcee23]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:14:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-60fcc7d8-c9ef-4567-b6c3-74040212fce1 tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:57 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15 Jun 30 16:14:57 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:14:57 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:14:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Flow 'volume_create_manager' (5f4bf1ca-69dd-4da3-9862-4714f572b2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:14:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00d9afe-1c7f-4b92-accb-73e03a3f4b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00d9afe-1c7f-4b92-accb-73e03a3f4b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1228796657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab86245d-71d0-4e59-b5fe-4ae8861543e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b028e64314c04b4c9e91bce8353f2570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:14:58Z,use_quota=True,user_id='f524b50a50ba4120b490ab57be3f8b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae442259-66d4-485a-b8ba-fad1ccd1cffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae442259-66d4-485a-b8ba-fad1ccd1cffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86915f09-8d20-45a0-9c85-42d68a936945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86915f09-8d20-45a0-9c85-42d68a936945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab86245d-71d0-4e59-b5fe-4ae8861543e5', 'volume_name': 'volume-ab86245d-71d0-4e59-b5fe-4ae8861543e5', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448f9bb5-5713-4f50-bdf3-25f1e17273a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448f9bb5-5713-4f50-bdf3-25f1e17273a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:14:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ced1c57-9d8c-41d4-a9c0-51f4d94246fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:14:57 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Volume ab86245d-71d0-4e59-b5fe-4ae8861543e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab86245d-71d0-4e59-b5fe-4ae8861543e5', 'volume_size': 1} Jun 30 16:14:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:14:57 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Jun 30 16:14:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-60fcc7d8-c9ef-4567-b6c3-74040212fce1 tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15" returned: 0 in 0.924s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:14:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-60fcc7d8-c9ef-4567-b6c3-74040212fce1 tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:57 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69 1G Jun 30 16:14:57 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:14:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:14:58 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Jun 30 16:14:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-60fcc7d8-c9ef-4567-b6c3-74040212fce1 tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69 1G" returned: 0 in 0.794s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:14:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-60fcc7d8-c9ef-4567-b6c3-74040212fce1 tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-384d3cd4-0824-4437-89e1-58dbd06c7b15 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:58 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-384d3cd4-0824-4437-89e1-58dbd06c7b15 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69 Jun 30 16:14:58 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:14:59 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Jun 30 16:14:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-60fcc7d8-c9ef-4567-b6c3-74040212fce1 tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-384d3cd4-0824-4437-89e1-58dbd06c7b15 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69" returned: 0 in 0.651s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:14:59 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-60fcc7d8-c9ef-4567-b6c3-74040212fce1 tempest-VolumesSnapshotListTestJSON-1665070985 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69 is being set with open permissions: ugo+rw Jun 30 16:14:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-60fcc7d8-c9ef-4567-b6c3-74040212fce1 tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:59 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69 Jun 30 16:14:59 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:14:59 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Jun 30 16:14:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-60fcc7d8-c9ef-4567-b6c3-74040212fce1 tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69" returned: 0 in 0.596s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:14:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-60fcc7d8-c9ef-4567-b6c3-74040212fce1 tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:14:59 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.info Jun 30 16:14:59 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:00 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-60fcc7d8-c9ef-4567-b6c3-74040212fce1 tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.info" returned: 0 in 0.634s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:00 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-60fcc7d8-c9ef-4567-b6c3-74040212fce1 tempest-VolumesSnapshotListTestJSON-1665070985 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.info is being set with open permissions: ugo+rw Jun 30 16:15:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-60fcc7d8-c9ef-4567-b6c3-74040212fce1 tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:00 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.info Jun 30 16:15:00 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:01 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-60fcc7d8-c9ef-4567-b6c3-74040212fce1 tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.info" returned: 0 in 0.660s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-60fcc7d8-c9ef-4567-b6c3-74040212fce1 tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.356s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 32.158s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:15:01 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-87671596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d4eb1c-602a-4f55-b680-8534fa02c533,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8ddf5bcfe32f4f3bb1fcebacf41f90e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:14:29Z,use_quota=True,user_id='56561341fd35463d957378f068eabcb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:15:01 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Creating volume 17d4eb1c-602a-4f55-b680-8534fa02c533 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:15:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:15:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:15:01 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:15:01 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:15:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:01 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:15:01 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:15:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17d4eb1c-602a-4f55-b680-8534fa02c533 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:01 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17d4eb1c-602a-4f55-b680-8534fa02c533 1073741824 Jun 30 16:15:01 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:01 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-60fcc7d8-c9ef-4567-b6c3-74040212fce1 tempest-VolumesSnapshotListTestJSON-1665070985 None] Create snapshot completed successfully Jun 30 16:15:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-922e05cf-7f30-404e-970d-c4ab604c6c08 tempest-VolumesSnapshotListTestJSON-1665070985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:15:02 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17d4eb1c-602a-4f55-b680-8534fa02c533 1073741824" returned: 0 in 0.965s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17d4eb1c-602a-4f55-b680-8534fa02c533 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:02 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17d4eb1c-602a-4f55-b680-8534fa02c533 Jun 30 16:15:02 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:02 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17d4eb1c-602a-4f55-b680-8534fa02c533" returned: 0 in 0.654s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:15:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.126s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:15:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1228796657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab86245d-71d0-4e59-b5fe-4ae8861543e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b028e64314c04b4c9e91bce8353f2570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:14:58Z,use_quota=True,user_id='f524b50a50ba4120b490ab57be3f8b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:15:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Creating volume ab86245d-71d0-4e59-b5fe-4ae8861543e5 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:15:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:15:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:15:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:15:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:15:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:15:02 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:15:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ab86245d-71d0-4e59-b5fe-4ae8861543e5 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:02 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ab86245d-71d0-4e59-b5fe-4ae8861543e5 1073741824 Jun 30 16:15:02 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d2ab82-a6bc-4030-9bf4-5d9004e3b7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d4eb1c-602a-4f55-b680-8534fa02c533', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b672bcd-532e-4b54-8cc0-d99403582164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:02 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Volume volume-17d4eb1c-602a-4f55-b680-8534fa02c533 (17d4eb1c-602a-4f55-b680-8534fa02c533): created successfully Jun 30 16:15:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b672bcd-532e-4b54-8cc0-d99403582164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Flow 'volume_create_manager' (fbc851e2-aba5-4acd-bf73-9a9808d4102a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:15:03 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-96afd975-008e-4bd1-b91b-02ea7c0150a2 tempest-VolumesTestJSON-786994339 None] Created volume successfully. Jun 30 16:15:03 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ab86245d-71d0-4e59-b5fe-4ae8861543e5 1073741824" returned: 0 in 0.859s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ab86245d-71d0-4e59-b5fe-4ae8861543e5 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:03 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ab86245d-71d0-4e59-b5fe-4ae8861543e5 Jun 30 16:15:03 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:04 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ab86245d-71d0-4e59-b5fe-4ae8861543e5" returned: 0 in 0.638s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:04 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:15:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 6.539s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:15:04 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ced1c57-9d8c-41d4-a9c0-51f4d94246fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab86245d-71d0-4e59-b5fe-4ae8861543e5', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:04 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22e081f-91be-4321-9c94-4939ac5f9e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:04 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[61da4da3-030e-4fe1-8f37-68b6b278f915]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:15:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:04 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Volume volume-ab86245d-71d0-4e59-b5fe-4ae8861543e5 (ab86245d-71d0-4e59-b5fe-4ae8861543e5): created successfully Jun 30 16:15:04 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22e081f-91be-4321-9c94-4939ac5f9e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:04 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Flow 'volume_create_manager' (5f4bf1ca-69dd-4da3-9862-4714f572b2f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:15:04 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-a9009664-5e45-4f5b-a482-7b1b19db77cc tempest-AttachVolumeNegativeTest-2129882576 None] Created volume successfully. Jun 30 16:15:04 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 Jun 30 16:15:04 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:05 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-642fe6ca-fefa-4e53-abfc-8fdb5ffabb99 tempest-VolumesTestJSON-786994339 None] Acquiring lock "cinder-17d4eb1c-602a-4f55-b680-8534fa02c533-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:05 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-642fe6ca-fefa-4e53-abfc-8fdb5ffabb99 tempest-VolumesTestJSON-786994339 None] Lock "cinder-17d4eb1c-602a-4f55-b680-8534fa02c533-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:05 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-642fe6ca-fefa-4e53-abfc-8fdb5ffabb99 tempest-VolumesTestJSON-786994339 None] Acquiring lock "cinder-quobyte-17d4eb1c-602a-4f55-b680-8534fa02c533" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:05 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-642fe6ca-fefa-4e53-abfc-8fdb5ffabb99 tempest-VolumesTestJSON-786994339 None] Lock "cinder-quobyte-17d4eb1c-602a-4f55-b680-8534fa02c533" acquired by "delete_volume" :: waited 0.022s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:05 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00435fa-4c80-4be4-992d-cdf88b3f6031]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:15:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-642fe6ca-fefa-4e53-abfc-8fdb5ffabb99 tempest-VolumesTestJSON-786994339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17d4eb1c-602a-4f55-b680-8534fa02c533 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:05 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67" returned: 0 in 0.995s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:05 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17d4eb1c-602a-4f55-b680-8534fa02c533 Jun 30 16:15:05 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:05 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb88976c-c49e-4cbf-95f5-e29b10138eae]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:15:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:05 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 Jun 30 16:15:05 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:06 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-642fe6ca-fefa-4e53-abfc-8fdb5ffabb99 tempest-VolumesTestJSON-786994339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17d4eb1c-602a-4f55-b680-8534fa02c533" returned: 0 in 0.945s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:06 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-642fe6ca-fefa-4e53-abfc-8fdb5ffabb99 tempest-VolumesTestJSON-786994339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17d4eb1c-602a-4f55-b680-8534fa02c533 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67" returned: 0 in 0.794s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 /opt/stack/data/cinder/conversion/f44ba4ac-5773-4ad1-861b-ee6d1ae66a67.temp_image.a8ce5799-2dcf-412d-9f9c-ad588bdc1855g_4bf_8i.img {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:06 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17d4eb1c-602a-4f55-b680-8534fa02c533 Jun 30 16:15:06 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:06 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 /opt/stack/data/cinder/conversion/f44ba4ac-5773-4ad1-861b-ee6d1ae66a67.temp_image.a8ce5799-2dcf-412d-9f9c-ad588bdc1855g_4bf_8i.img Jun 30 16:15:06 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:06 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-642fe6ca-fefa-4e53-abfc-8fdb5ffabb99 tempest-VolumesTestJSON-786994339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17d4eb1c-602a-4f55-b680-8534fa02c533" returned: 0 in 0.657s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-642fe6ca-fefa-4e53-abfc-8fdb5ffabb99 tempest-VolumesTestJSON-786994339 None] Lock "cinder-quobyte-17d4eb1c-602a-4f55-b680-8534fa02c533" released by "delete_volume" :: held 1.647s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:07 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-642fe6ca-fefa-4e53-abfc-8fdb5ffabb99 tempest-VolumesTestJSON-786994339 None] Created reservations ['5ea47084-48c3-4057-89bd-78e51d8de866', 'ac7bc313-2c07-4022-b578-bc20468a9bb6', 'babd1b67-8aea-4604-881b-e3362aa34b18', 'b0bee17d-a953-4f24-83f5-b08c6347d2e9'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:15:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-642fe6ca-fefa-4e53-abfc-8fdb5ffabb99 tempest-VolumesTestJSON-786994339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:15:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-642fe6ca-fefa-4e53-abfc-8fdb5ffabb99 tempest-VolumesTestJSON-786994339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:15:07 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-642fe6ca-fefa-4e53-abfc-8fdb5ffabb99 tempest-VolumesTestJSON-786994339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:15:07 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-642fe6ca-fefa-4e53-abfc-8fdb5ffabb99 tempest-VolumesTestJSON-786994339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:15:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-642fe6ca-fefa-4e53-abfc-8fdb5ffabb99 tempest-VolumesTestJSON-786994339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-642fe6ca-fefa-4e53-abfc-8fdb5ffabb99 tempest-VolumesTestJSON-786994339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:07 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:15:07 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:07 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-426cf984-50a3-4bd9-bdce-571668b7d6ed tempest-VolumesTestJSON-786994339 None] Acquiring lock "cinder-7f2f9b0c-283f-44fb-8510-1d75c31a2a26-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:07 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-426cf984-50a3-4bd9-bdce-571668b7d6ed tempest-VolumesTestJSON-786994339 None] Lock "cinder-7f2f9b0c-283f-44fb-8510-1d75c31a2a26-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:07 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-426cf984-50a3-4bd9-bdce-571668b7d6ed tempest-VolumesTestJSON-786994339 None] Acquiring lock "cinder-quobyte-7f2f9b0c-283f-44fb-8510-1d75c31a2a26" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:07 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-426cf984-50a3-4bd9-bdce-571668b7d6ed tempest-VolumesTestJSON-786994339 None] Lock "cinder-quobyte-7f2f9b0c-283f-44fb-8510-1d75c31a2a26" acquired by "delete_volume" :: waited 0.058s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:07 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5f4437-3c2c-4ba7-9828-9fa2c7a1a5a4]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:15:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-426cf984-50a3-4bd9-bdce-571668b7d6ed tempest-VolumesTestJSON-786994339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7f2f9b0c-283f-44fb-8510-1d75c31a2a26 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:08 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-642fe6ca-fefa-4e53-abfc-8fdb5ffabb99 tempest-VolumesTestJSON-786994339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.089s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:08 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-642fe6ca-fefa-4e53-abfc-8fdb5ffabb99 tempest-VolumesTestJSON-786994339 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:15:08 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-642fe6ca-fefa-4e53-abfc-8fdb5ffabb99 tempest-VolumesTestJSON-786994339 None] Deleted volume successfully. Jun 30 16:15:08 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7f2f9b0c-283f-44fb-8510-1d75c31a2a26 Jun 30 16:15:08 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:08 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-642fe6ca-fefa-4e53-abfc-8fdb5ffabb99 tempest-VolumesTestJSON-786994339 None] Lock "cinder-17d4eb1c-602a-4f55-b680-8534fa02c533-delete_volume" released by "delete_volume" :: held 3.150s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-acbbdb10-3e5a-4282-8967-1adf394ad6fb req-2b9a4218-7b03-4e7e-871a-11e58fed8a7a tempest-AttachVolumeNegativeTest-2129882576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:15:09 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-426cf984-50a3-4bd9-bdce-571668b7d6ed tempest-VolumesTestJSON-786994339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7f2f9b0c-283f-44fb-8510-1d75c31a2a26" returned: 0 in 1.908s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-426cf984-50a3-4bd9-bdce-571668b7d6ed tempest-VolumesTestJSON-786994339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7f2f9b0c-283f-44fb-8510-1d75c31a2a26 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:09 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7f2f9b0c-283f-44fb-8510-1d75c31a2a26 Jun 30 16:15:09 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:11 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-426cf984-50a3-4bd9-bdce-571668b7d6ed tempest-VolumesTestJSON-786994339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7f2f9b0c-283f-44fb-8510-1d75c31a2a26" returned: 0 in 1.535s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:11 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-426cf984-50a3-4bd9-bdce-571668b7d6ed tempest-VolumesTestJSON-786994339 None] Lock "cinder-quobyte-7f2f9b0c-283f-44fb-8510-1d75c31a2a26" released by "delete_volume" :: held 3.558s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:11 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-426cf984-50a3-4bd9-bdce-571668b7d6ed tempest-VolumesTestJSON-786994339 None] Created reservations ['ee9072bc-f199-4222-a919-32febfe24b71', 'df9cf643-1224-4af8-85e7-5e79a99a1f02', 'c13592bb-47c5-478a-b6dd-34ead5a3423e', 'c01fc06f-725f-447e-b996-a15f08d9eb97'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:15:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-426cf984-50a3-4bd9-bdce-571668b7d6ed tempest-VolumesTestJSON-786994339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:15:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-426cf984-50a3-4bd9-bdce-571668b7d6ed tempest-VolumesTestJSON-786994339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:15:11 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-426cf984-50a3-4bd9-bdce-571668b7d6ed tempest-VolumesTestJSON-786994339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:15:11 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-426cf984-50a3-4bd9-bdce-571668b7d6ed tempest-VolumesTestJSON-786994339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:15:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-426cf984-50a3-4bd9-bdce-571668b7d6ed tempest-VolumesTestJSON-786994339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-426cf984-50a3-4bd9-bdce-571668b7d6ed tempest-VolumesTestJSON-786994339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:11 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:15:11 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:11 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 /opt/stack/data/cinder/conversion/f44ba4ac-5773-4ad1-861b-ee6d1ae66a67.temp_image.a8ce5799-2dcf-412d-9f9c-ad588bdc1855g_4bf_8i.img" returned: 0 in 5.480s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:11 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[df021a1a-7133-42d2-96cb-e0982b2efaae]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:15:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:11 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 Jun 30 16:15:11 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:12 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-426cf984-50a3-4bd9-bdce-571668b7d6ed tempest-VolumesTestJSON-786994339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.653s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:12 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-426cf984-50a3-4bd9-bdce-571668b7d6ed tempest-VolumesTestJSON-786994339 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:15:12 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-426cf984-50a3-4bd9-bdce-571668b7d6ed tempest-VolumesTestJSON-786994339 None] Deleted volume successfully. Jun 30 16:15:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-426cf984-50a3-4bd9-bdce-571668b7d6ed tempest-VolumesTestJSON-786994339 None] Lock "cinder-7f2f9b0c-283f-44fb-8510-1d75c31a2a26-delete_volume" released by "delete_volume" :: held 4.666s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ad9f800e-3095-49b4-a94d-5d7f384bcd86 tempest-VolumesTestJSON-786994339 None] Acquiring lock "cinder-f6f664a0-73e7-482a-ac4b-2f43bd177c29-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ad9f800e-3095-49b4-a94d-5d7f384bcd86 tempest-VolumesTestJSON-786994339 None] Lock "cinder-f6f664a0-73e7-482a-ac4b-2f43bd177c29-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ad9f800e-3095-49b4-a94d-5d7f384bcd86 tempest-VolumesTestJSON-786994339 None] Acquiring lock "cinder-quobyte-f6f664a0-73e7-482a-ac4b-2f43bd177c29" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ad9f800e-3095-49b4-a94d-5d7f384bcd86 tempest-VolumesTestJSON-786994339 None] Lock "cinder-quobyte-f6f664a0-73e7-482a-ac4b-2f43bd177c29" acquired by "delete_volume" :: waited 0.025s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:12 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0667d0-7e51-42b3-8971-fe313755a09e]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:15:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ad9f800e-3095-49b4-a94d-5d7f384bcd86 tempest-VolumesTestJSON-786994339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f664a0-73e7-482a-ac4b-2f43bd177c29 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:12 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f664a0-73e7-482a-ac4b-2f43bd177c29 Jun 30 16:15:12 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:12 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67" returned: 0 in 0.942s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:12 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] Image conversion details: src /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67, size 1024.00 MB, duration 5.48 sec, destination /opt/stack/data/cinder/conversion/f44ba4ac-5773-4ad1-861b-ee6d1ae66a67.temp_image.a8ce5799-2dcf-412d-9f9c-ad588bdc1855g_4bf_8i.img {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:15:12 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] Converted 1024.00 MB image at 186.81 MB/s Jun 30 16:15:12 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] a8ce5799-2dcf-412d-9f9c-ad588bdc1855 was raw, converting to qcow2 {{(pid=93781) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 30 16:15:12 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b77aaec-134f-4c31-855a-83813b6d914c]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:15:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f44ba4ac-5773-4ad1-861b-ee6d1ae66a67.temp_image.a8ce5799-2dcf-412d-9f9c-ad588bdc1855g_4bf_8i.img {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:12 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f44ba4ac-5773-4ad1-861b-ee6d1ae66a67.temp_image.a8ce5799-2dcf-412d-9f9c-ad588bdc1855g_4bf_8i.img Jun 30 16:15:12 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:13 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ad9f800e-3095-49b4-a94d-5d7f384bcd86 tempest-VolumesTestJSON-786994339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f664a0-73e7-482a-ac4b-2f43bd177c29" returned: 0 in 0.831s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ad9f800e-3095-49b4-a94d-5d7f384bcd86 tempest-VolumesTestJSON-786994339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f664a0-73e7-482a-ac4b-2f43bd177c29 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:13 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f664a0-73e7-482a-ac4b-2f43bd177c29 Jun 30 16:15:13 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:13 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f44ba4ac-5773-4ad1-861b-ee6d1ae66a67.temp_image.a8ce5799-2dcf-412d-9f9c-ad588bdc1855g_4bf_8i.img" returned: 0 in 0.723s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f44ba4ac-5773-4ad1-861b-ee6d1ae66a67.temp_image.a8ce5799-2dcf-412d-9f9c-ad588bdc1855g_4bf_8i.img {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:13 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f44ba4ac-5773-4ad1-861b-ee6d1ae66a67.temp_image.a8ce5799-2dcf-412d-9f9c-ad588bdc1855g_4bf_8i.img Jun 30 16:15:13 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:14 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ad9f800e-3095-49b4-a94d-5d7f384bcd86 tempest-VolumesTestJSON-786994339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f664a0-73e7-482a-ac4b-2f43bd177c29" returned: 0 in 0.642s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:14 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ad9f800e-3095-49b4-a94d-5d7f384bcd86 tempest-VolumesTestJSON-786994339 None] Lock "cinder-quobyte-f6f664a0-73e7-482a-ac4b-2f43bd177c29" released by "delete_volume" :: held 1.536s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:14 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-ad9f800e-3095-49b4-a94d-5d7f384bcd86 tempest-VolumesTestJSON-786994339 None] Created reservations ['f4a1a53b-098d-4c6d-9b81-c23f3248bc81', 'c1217819-bd1f-4a1d-8dd3-afaa83e9a861', '63c60484-0810-46dc-8dea-d742ae20b469', '9bdc53f3-57a8-4716-ad7b-38b6f546d84b'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:15:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ad9f800e-3095-49b4-a94d-5d7f384bcd86 tempest-VolumesTestJSON-786994339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:15:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ad9f800e-3095-49b4-a94d-5d7f384bcd86 tempest-VolumesTestJSON-786994339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:15:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ad9f800e-3095-49b4-a94d-5d7f384bcd86 tempest-VolumesTestJSON-786994339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:15:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ad9f800e-3095-49b4-a94d-5d7f384bcd86 tempest-VolumesTestJSON-786994339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:15:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ad9f800e-3095-49b4-a94d-5d7f384bcd86 tempest-VolumesTestJSON-786994339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ad9f800e-3095-49b4-a94d-5d7f384bcd86 tempest-VolumesTestJSON-786994339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:14 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:14 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:15:14 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f44ba4ac-5773-4ad1-861b-ee6d1ae66a67.temp_image.a8ce5799-2dcf-412d-9f9c-ad588bdc1855g_4bf_8i.img" returned: 1 in 0.742s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f44ba4ac-5773-4ad1-861b-ee6d1ae66a67.temp_image.a8ce5799-2dcf-412d-9f9c-ad588bdc1855g_4bf_8i.img' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:15:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f44ba4ac-5773-4ad1-861b-ee6d1ae66a67.temp_image.a8ce5799-2dcf-412d-9f9c-ad588bdc1855g_4bf_8i.img /opt/stack/data/cinder/conversion/vol_upload_2x26992m {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:14 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f44ba4ac-5773-4ad1-861b-ee6d1ae66a67.temp_image.a8ce5799-2dcf-412d-9f9c-ad588bdc1855g_4bf_8i.img /opt/stack/data/cinder/conversion/vol_upload_2x26992m Jun 30 16:15:14 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:14 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ad9f800e-3095-49b4-a94d-5d7f384bcd86 tempest-VolumesTestJSON-786994339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.666s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:14 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-ad9f800e-3095-49b4-a94d-5d7f384bcd86 tempest-VolumesTestJSON-786994339 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:15:14 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-ad9f800e-3095-49b4-a94d-5d7f384bcd86 tempest-VolumesTestJSON-786994339 None] Deleted volume successfully. Jun 30 16:15:14 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f44ba4ac-5773-4ad1-861b-ee6d1ae66a67.temp_image.a8ce5799-2dcf-412d-9f9c-ad588bdc1855g_4bf_8i.img /opt/stack/data/cinder/conversion/vol_upload_2x26992m" returned: 0 in 0.676s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:14 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] Image conversion details: src /opt/stack/data/cinder/conversion/f44ba4ac-5773-4ad1-861b-ee6d1ae66a67.temp_image.a8ce5799-2dcf-412d-9f9c-ad588bdc1855g_4bf_8i.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_2x26992m {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:15:14 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 30 16:15:14 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ad9f800e-3095-49b4-a94d-5d7f384bcd86 tempest-VolumesTestJSON-786994339 None] Lock "cinder-f6f664a0-73e7-482a-ac4b-2f43bd177c29-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:14 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fc629b-6306-406a-ac97-52e4a7e539fe]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:15:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2x26992m {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:15 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2x26992m Jun 30 16:15:15 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:15 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2x26992m" returned: 0 in 0.721s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.810s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] Uploaded volume to glance image-id: a8ce5799-2dcf-412d-9f9c-ad588bdc1855. {{(pid=93781) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 30 16:15:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-922e05cf-7f30-404e-970d-c4ab604c6c08 tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.318s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:15:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-922e05cf-7f30-404e-970d-c4ab604c6c08 tempest-VolumesSnapshotListTestJSON-1665070985 None] Creating offline snapshot 4206b382-8290-44a8-9c17-8ac3f2ddaf3f of volume 384d3cd4-0824-4437-89e1-58dbd06c7b15 {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:15:17 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-5b19d21f-0b85-4b7b-a226-a02a18f77d07 tempest-VolumesActionsTest-828599955 None] Copy volume to image completed successfully. Jun 30 16:15:17 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[8208cfe1-db62-4b25-98d3-ac8a49b14508]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:15:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-922e05cf-7f30-404e-970d-c4ab604c6c08 tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:17 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69 Jun 30 16:15:17 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:18 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-922e05cf-7f30-404e-970d-c4ab604c6c08 tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69" returned: 0 in 0.847s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:18 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-922e05cf-7f30-404e-970d-c4ab604c6c08 tempest-VolumesSnapshotListTestJSON-1665070985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-384d3cd4-0824-4437-89e1-58dbd06c7b15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:15:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-922e05cf-7f30-404e-970d-c4ab604c6c08 tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:18 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f 1G Jun 30 16:15:18 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:18 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3506da43-6477-4aab-9b65-1d228870454c tempest-VolumesActionsTest-828599955 None] Acquiring lock "cinder-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:18 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3506da43-6477-4aab-9b65-1d228870454c tempest-VolumesActionsTest-828599955 None] Lock "cinder-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:18 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3506da43-6477-4aab-9b65-1d228870454c tempest-VolumesActionsTest-828599955 None] Acquiring lock "cinder-quobyte-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:18 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3506da43-6477-4aab-9b65-1d228870454c tempest-VolumesActionsTest-828599955 None] Lock "cinder-quobyte-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67" acquired by "delete_volume" :: waited 0.016s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:18 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ff3fca-3dd4-4cda-be65-ce66755367b3]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:15:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3506da43-6477-4aab-9b65-1d228870454c tempest-VolumesActionsTest-828599955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:18 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 Jun 30 16:15:18 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:19 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-922e05cf-7f30-404e-970d-c4ab604c6c08 tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f 1G" returned: 0 in 1.112s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-922e05cf-7f30-404e-970d-c4ab604c6c08 tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:19 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f Jun 30 16:15:19 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:19 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3506da43-6477-4aab-9b65-1d228870454c tempest-VolumesActionsTest-828599955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67" returned: 0 in 0.923s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3506da43-6477-4aab-9b65-1d228870454c tempest-VolumesActionsTest-828599955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:19 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67 Jun 30 16:15:19 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:20 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-922e05cf-7f30-404e-970d-c4ab604c6c08 tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f" returned: 0 in 0.847s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:20 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-922e05cf-7f30-404e-970d-c4ab604c6c08 tempest-VolumesSnapshotListTestJSON-1665070985 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f is being set with open permissions: ugo+rw Jun 30 16:15:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-922e05cf-7f30-404e-970d-c4ab604c6c08 tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:20 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f Jun 30 16:15:20 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:20 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3506da43-6477-4aab-9b65-1d228870454c tempest-VolumesActionsTest-828599955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67" returned: 0 in 0.913s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3506da43-6477-4aab-9b65-1d228870454c tempest-VolumesActionsTest-828599955 None] Lock "cinder-quobyte-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67" released by "delete_volume" :: held 1.889s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:20 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-3506da43-6477-4aab-9b65-1d228870454c tempest-VolumesActionsTest-828599955 None] Created reservations ['2f44e001-1190-4407-ab3d-896b353bc4f5', '366cb620-50ef-4eed-b506-45bedd44dfe4', 'e7a5f6a3-2202-47c1-a519-81768f6b37bf', '0780da6d-59df-4626-ae9a-9bf3262d0ff1'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:15:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3506da43-6477-4aab-9b65-1d228870454c tempest-VolumesActionsTest-828599955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:15:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3506da43-6477-4aab-9b65-1d228870454c tempest-VolumesActionsTest-828599955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:15:20 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3506da43-6477-4aab-9b65-1d228870454c tempest-VolumesActionsTest-828599955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:15:20 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3506da43-6477-4aab-9b65-1d228870454c tempest-VolumesActionsTest-828599955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:15:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3506da43-6477-4aab-9b65-1d228870454c tempest-VolumesActionsTest-828599955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3506da43-6477-4aab-9b65-1d228870454c tempest-VolumesActionsTest-828599955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:20 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:15:20 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:20 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-922e05cf-7f30-404e-970d-c4ab604c6c08 tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f" returned: 0 in 0.684s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-922e05cf-7f30-404e-970d-c4ab604c6c08 tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.623s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-acbbdb10-3e5a-4282-8967-1adf394ad6fb req-2b9a4218-7b03-4e7e-871a-11e58fed8a7a tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.683s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:15:20 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ea4f43-4553-477c-b135-146b7e781f37]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:15:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-acbbdb10-3e5a-4282-8967-1adf394ad6fb req-2b9a4218-7b03-4e7e-871a-11e58fed8a7a tempest-AttachVolumeNegativeTest-2129882576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ab86245d-71d0-4e59-b5fe-4ae8861543e5 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:20 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-922e05cf-7f30-404e-970d-c4ab604c6c08 tempest-VolumesSnapshotListTestJSON-1665070985 None] Create snapshot completed successfully Jun 30 16:15:21 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ab86245d-71d0-4e59-b5fe-4ae8861543e5 Jun 30 16:15:21 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:21 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3506da43-6477-4aab-9b65-1d228870454c tempest-VolumesActionsTest-828599955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.825s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:21 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-3506da43-6477-4aab-9b65-1d228870454c tempest-VolumesActionsTest-828599955 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:15:21 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-3506da43-6477-4aab-9b65-1d228870454c tempest-VolumesActionsTest-828599955 None] Deleted volume successfully. Jun 30 16:15:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3506da43-6477-4aab-9b65-1d228870454c tempest-VolumesActionsTest-828599955 None] Lock "cinder-f44ba4ac-5773-4ad1-861b-ee6d1ae66a67-delete_volume" released by "delete_volume" :: held 2.995s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:22 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-acbbdb10-3e5a-4282-8967-1adf394ad6fb req-2b9a4218-7b03-4e7e-871a-11e58fed8a7a tempest-AttachVolumeNegativeTest-2129882576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ab86245d-71d0-4e59-b5fe-4ae8861543e5" returned: 0 in 1.176s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-acbbdb10-3e5a-4282-8967-1adf394ad6fb req-2b9a4218-7b03-4e7e-871a-11e58fed8a7a tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.218s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:22 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-acbbdb10-3e5a-4282-8967-1adf394ad6fb req-2b9a4218-7b03-4e7e-871a-11e58fed8a7a tempest-AttachVolumeNegativeTest-2129882576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a', 'name': 'volume-ab86245d-71d0-4e59-b5fe-4ae8861543e5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50ac8926-a162-4fed-9610-07830df80675', 'enforce_multipath': True} {{(pid=93781) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 30 16:15:22 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-acbbdb10-3e5a-4282-8967-1adf394ad6fb req-2b9a4218-7b03-4e7e-871a-11e58fed8a7a tempest-AttachVolumeNegativeTest-2129882576 None] attachment_update completed successfully. Jun 30 16:15:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-94b15dc1-1518-41cf-988e-dcf574c58f47 tempest-VolumesSnapshotListTestJSON-1665070985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:15:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-94b15dc1-1518-41cf-988e-dcf574c58f47 tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:15:22 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-94b15dc1-1518-41cf-988e-dcf574c58f47 tempest-VolumesSnapshotListTestJSON-1665070985 None] Creating offline snapshot e3fbaf59-5c65-436b-9a28-459f5ddb6880 of volume 384d3cd4-0824-4437-89e1-58dbd06c7b15 {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:15:22 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7a53cc-3326-431e-ba65-2a1686a4c086]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:15:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-94b15dc1-1518-41cf-988e-dcf574c58f47 tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:22 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f Jun 30 16:15:22 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:23 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-94b15dc1-1518-41cf-988e-dcf574c58f47 tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f" returned: 0 in 0.939s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-94b15dc1-1518-41cf-988e-dcf574c58f47 tempest-VolumesSnapshotListTestJSON-1665070985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-384d3cd4-0824-4437-89e1-58dbd06c7b15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:15:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-94b15dc1-1518-41cf-988e-dcf574c58f47 tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.e3fbaf59-5c65-436b-9a28-459f5ddb6880 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:23 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.e3fbaf59-5c65-436b-9a28-459f5ddb6880 1G Jun 30 16:15:23 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-7e472622-8c51-4e66-9b5c-5b7590862aae tempest-BackendsCapabilitiesAdminTestsJSON-2044174083 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576904296875, 'free_capacity_gb': 1775.7576904296875, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93781) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 30 16:15:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-75c82b7f-8fb0-4302-a969-b1117f07fff2 tempest-BackendsCapabilitiesAdminTestsJSON-2044174083 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576904296875, 'free_capacity_gb': 1775.7576904296875, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93781) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 30 16:15:24 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-94b15dc1-1518-41cf-988e-dcf574c58f47 tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.e3fbaf59-5c65-436b-9a28-459f5ddb6880 1G" returned: 0 in 1.080s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-94b15dc1-1518-41cf-988e-dcf574c58f47 tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.e3fbaf59-5c65-436b-9a28-459f5ddb6880 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:24 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.e3fbaf59-5c65-436b-9a28-459f5ddb6880 Jun 30 16:15:24 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:25 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-94b15dc1-1518-41cf-988e-dcf574c58f47 tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.e3fbaf59-5c65-436b-9a28-459f5ddb6880" returned: 0 in 0.852s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:25 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-94b15dc1-1518-41cf-988e-dcf574c58f47 tempest-VolumesSnapshotListTestJSON-1665070985 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.e3fbaf59-5c65-436b-9a28-459f5ddb6880 is being set with open permissions: ugo+rw Jun 30 16:15:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-94b15dc1-1518-41cf-988e-dcf574c58f47 tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.e3fbaf59-5c65-436b-9a28-459f5ddb6880 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:25 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.e3fbaf59-5c65-436b-9a28-459f5ddb6880 Jun 30 16:15:25 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:26 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-94b15dc1-1518-41cf-988e-dcf574c58f47 tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.e3fbaf59-5c65-436b-9a28-459f5ddb6880" returned: 0 in 0.831s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-94b15dc1-1518-41cf-988e-dcf574c58f47 tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.879s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:26 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-94b15dc1-1518-41cf-988e-dcf574c58f47 tempest-VolumesSnapshotListTestJSON-1665070985 None] Create snapshot completed successfully Jun 30 16:15:27 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4a7973ca-9e69-474a-9e0d-cb2719bc82b0 tempest-VolumesSnapshotListTestJSON-1665070985 None] Acquiring lock "cinder-e3fbaf59-5c65-436b-9a28-459f5ddb6880-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:27 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4a7973ca-9e69-474a-9e0d-cb2719bc82b0 tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "cinder-e3fbaf59-5c65-436b-9a28-459f5ddb6880-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:27 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4a7973ca-9e69-474a-9e0d-cb2719bc82b0 tempest-VolumesSnapshotListTestJSON-1665070985 None] Acquiring lock "cinder-quobyte-384d3cd4-0824-4437-89e1-58dbd06c7b15" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:27 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4a7973ca-9e69-474a-9e0d-cb2719bc82b0 tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "cinder-quobyte-384d3cd4-0824-4437-89e1-58dbd06c7b15" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:27 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4a7973ca-9e69-474a-9e0d-cb2719bc82b0 tempest-VolumesSnapshotListTestJSON-1665070985 None] Acquiring lock "cinder-quobyte-e3fbaf59-5c65-436b-9a28-459f5ddb6880" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:27 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4a7973ca-9e69-474a-9e0d-cb2719bc82b0 tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "cinder-quobyte-e3fbaf59-5c65-436b-9a28-459f5ddb6880" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:27 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-4a7973ca-9e69-474a-9e0d-cb2719bc82b0 tempest-VolumesSnapshotListTestJSON-1665070985 None] Deleting offline snapshot e3fbaf59-5c65-436b-9a28-459f5ddb6880 of volume 384d3cd4-0824-4437-89e1-58dbd06c7b15 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:15:27 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-4a7973ca-9e69-474a-9e0d-cb2719bc82b0 tempest-VolumesSnapshotListTestJSON-1665070985 None] snapshot_file for this snap is: volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.e3fbaf59-5c65-436b-9a28-459f5ddb6880 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:15:27 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[999e683b-b2f7-4d9e-b5c4-102ab0d8c71d]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:15:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4a7973ca-9e69-474a-9e0d-cb2719bc82b0 tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.e3fbaf59-5c65-436b-9a28-459f5ddb6880 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:27 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.e3fbaf59-5c65-436b-9a28-459f5ddb6880 Jun 30 16:15:27 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:29 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4a7973ca-9e69-474a-9e0d-cb2719bc82b0 tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.e3fbaf59-5c65-436b-9a28-459f5ddb6880" returned: 0 in 1.402s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-4a7973ca-9e69-474a-9e0d-cb2719bc82b0 tempest-VolumesSnapshotListTestJSON-1665070985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-384d3cd4-0824-4437-89e1-58dbd06c7b15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Flow 'volume_create_manager' (36bc7fb1-6e34-4bfb-9f36-7e9be34b7cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79986d03-1b4f-47b1-848b-89bfaff80dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6be5553-4d61-448d-9129-ce485041ac69]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4a7973ca-9e69-474a-9e0d-cb2719bc82b0 tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79986d03-1b4f-47b1-848b-89bfaff80dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1281875943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d0c305-19a5-4002-bfcf-e728783ff41a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='92f194d325924bb2b41ce787c90bd59f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:15:29Z,use_quota=True,user_id='8a13992f8fac4d8eb78626038a70f046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ce8ee9-da3e-4969-880a-d1486b0bdcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ce8ee9-da3e-4969-880a-d1486b0bdcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a735474f-cf82-4793-b824-d6401636139b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a735474f-cf82-4793-b824-d6401636139b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6d0c305-19a5-4002-bfcf-e728783ff41a', 'volume_name': 'volume-a6d0c305-19a5-4002-bfcf-e728783ff41a', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9f37c2-7ccf-4022-8355-7698cddf6334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9f37c2-7ccf-4022-8355-7698cddf6334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4119c9-9fde-4492-945d-ae87e3ba425f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:29 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Volume a6d0c305-19a5-4002-bfcf-e728783ff41a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6d0c305-19a5-4002-bfcf-e728783ff41a', 'volume_size': 1} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1281875943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d0c305-19a5-4002-bfcf-e728783ff41a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='92f194d325924bb2b41ce787c90bd59f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:15:29Z,use_quota=True,user_id='8a13992f8fac4d8eb78626038a70f046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Creating volume a6d0c305-19a5-4002-bfcf-e728783ff41a {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:15:29 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6d0c305-19a5-4002-bfcf-e728783ff41a 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:29 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6d0c305-19a5-4002-bfcf-e728783ff41a 1073741824 Jun 30 16:15:29 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:29 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f Jun 30 16:15:29 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:29 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-1ec0a36d-2029-48c1-94f7-1add3e4c0264 req-fa2d5e90-e0e8-4950-a0c6-e588b1972d7b tempest-AttachVolumeNegativeTest-2129882576 None] Terminate volume connection completed successfully. Jun 30 16:15:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-1ec0a36d-2029-48c1-94f7-1add3e4c0264 req-fa2d5e90-e0e8-4950-a0c6-e588b1972d7b tempest-AttachVolumeNegativeTest-2129882576 None] Deleting attachment 50ac8926-a162-4fed-9610-07830df80675. {{(pid=93781) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 30 16:15:30 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4a7973ca-9e69-474a-9e0d-cb2719bc82b0 tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f" returned: 0 in 1.051s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-4a7973ca-9e69-474a-9e0d-cb2719bc82b0 tempest-VolumesSnapshotListTestJSON-1665070985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-384d3cd4-0824-4437-89e1-58dbd06c7b15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:15:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4a7973ca-9e69-474a-9e0d-cb2719bc82b0 tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.e3fbaf59-5c65-436b-9a28-459f5ddb6880 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:30 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.e3fbaf59-5c65-436b-9a28-459f5ddb6880 Jun 30 16:15:30 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:30 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6d0c305-19a5-4002-bfcf-e728783ff41a 1073741824" returned: 0 in 1.113s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6d0c305-19a5-4002-bfcf-e728783ff41a {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:30 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6d0c305-19a5-4002-bfcf-e728783ff41a Jun 30 16:15:30 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:31 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6d0c305-19a5-4002-bfcf-e728783ff41a" returned: 0 in 0.745s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:15:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.912s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4119c9-9fde-4492-945d-ae87e3ba425f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6d0c305-19a5-4002-bfcf-e728783ff41a', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e8bdeb-3643-4f2b-8dad-10ddffbf178d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:31 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Volume volume-a6d0c305-19a5-4002-bfcf-e728783ff41a (a6d0c305-19a5-4002-bfcf-e728783ff41a): created successfully Jun 30 16:15:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e8bdeb-3643-4f2b-8dad-10ddffbf178d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Flow 'volume_create_manager' (36bc7fb1-6e34-4bfb-9f36-7e9be34b7cdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:15:31 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-1daa83f4-fb1e-4b21-aae3-89901a61709e tempest-VolumesListTestJSON-589206054 None] Created volume successfully. Jun 30 16:15:31 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4a7973ca-9e69-474a-9e0d-cb2719bc82b0 tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.e3fbaf59-5c65-436b-9a28-459f5ddb6880" returned: 0 in 1.169s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4a7973ca-9e69-474a-9e0d-cb2719bc82b0 tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.e3fbaf59-5c65-436b-9a28-459f5ddb6880 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:31 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.e3fbaf59-5c65-436b-9a28-459f5ddb6880 Jun 30 16:15:31 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:32 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4a7973ca-9e69-474a-9e0d-cb2719bc82b0 tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.e3fbaf59-5c65-436b-9a28-459f5ddb6880" returned: 0 in 0.907s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:32 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4a7973ca-9e69-474a-9e0d-cb2719bc82b0 tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "cinder-quobyte-e3fbaf59-5c65-436b-9a28-459f5ddb6880" released by "_delete_snapshot" :: held 4.730s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:32 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4a7973ca-9e69-474a-9e0d-cb2719bc82b0 tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "cinder-quobyte-384d3cd4-0824-4437-89e1-58dbd06c7b15" released by "delete_snapshot" :: held 4.770s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:32 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-4a7973ca-9e69-474a-9e0d-cb2719bc82b0 tempest-VolumesSnapshotListTestJSON-1665070985 None] Created reservations ['4aa718c0-9830-45af-86a1-6637ceaea3c2', '3a6321ea-9011-4fa4-a30b-0cbdabc60926', 'f581bbf5-6ad9-42ec-a778-a1d348f35d8d', '4cf15efd-06d0-4232-8558-4c1d7f6fcbbb'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:15:32 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-4a7973ca-9e69-474a-9e0d-cb2719bc82b0 tempest-VolumesSnapshotListTestJSON-1665070985 None] Delete snapshot completed successfully. Jun 30 16:15:32 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4a7973ca-9e69-474a-9e0d-cb2719bc82b0 tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "cinder-e3fbaf59-5c65-436b-9a28-459f5ddb6880-delete_snapshot" released by "delete_snapshot" :: held 4.989s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f96268e8-0c39-4027-8613-f1ea1e61056c tempest-VolumesSnapshotListTestJSON-1665070985 None] Acquiring lock "cinder-4206b382-8290-44a8-9c17-8ac3f2ddaf3f-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:33 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:15:33 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f96268e8-0c39-4027-8613-f1ea1e61056c tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "cinder-4206b382-8290-44a8-9c17-8ac3f2ddaf3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.191s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f96268e8-0c39-4027-8613-f1ea1e61056c tempest-VolumesSnapshotListTestJSON-1665070985 None] Acquiring lock "cinder-quobyte-384d3cd4-0824-4437-89e1-58dbd06c7b15" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f96268e8-0c39-4027-8613-f1ea1e61056c tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "cinder-quobyte-384d3cd4-0824-4437-89e1-58dbd06c7b15" acquired by "delete_snapshot" :: waited 0.046s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f96268e8-0c39-4027-8613-f1ea1e61056c tempest-VolumesSnapshotListTestJSON-1665070985 None] Acquiring lock "cinder-quobyte-4206b382-8290-44a8-9c17-8ac3f2ddaf3f" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Flow 'volume_create_manager' (7c9c9c52-1dc5-4b97-86db-57a2b1663a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2b9efb-d684-499a-a198-c612b0441d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f96268e8-0c39-4027-8613-f1ea1e61056c tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "cinder-quobyte-4206b382-8290-44a8-9c17-8ac3f2ddaf3f" acquired by "_delete_snapshot" :: waited 0.089s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-f96268e8-0c39-4027-8613-f1ea1e61056c tempest-VolumesSnapshotListTestJSON-1665070985 None] Deleting offline snapshot 4206b382-8290-44a8-9c17-8ac3f2ddaf3f of volume 384d3cd4-0824-4437-89e1-58dbd06c7b15 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-f96268e8-0c39-4027-8613-f1ea1e61056c tempest-VolumesSnapshotListTestJSON-1665070985 None] snapshot_file for this snap is: volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2b9efb-d684-499a-a198-c612b0441d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1397145217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d14f33-b5a4-4f3f-8940-7b6a1c263367,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='92f194d325924bb2b41ce787c90bd59f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:15:33Z,use_quota=True,user_id='8a13992f8fac4d8eb78626038a70f046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a46c38-5940-4f36-9444-e182fbb74c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a46c38-5940-4f36-9444-e182fbb74c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1b94f3-0a21-47ba-ba10-083c83d38ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1b94f3-0a21-47ba-ba10-083c83d38ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37d14f33-b5a4-4f3f-8940-7b6a1c263367', 'volume_name': 'volume-37d14f33-b5a4-4f3f-8940-7b6a1c263367', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275f9051-6dca-4790-8433-a8e767fa1c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275f9051-6dca-4790-8433-a8e767fa1c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e380810-b8b7-40b5-974b-bf3e5658bc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:33 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Volume 37d14f33-b5a4-4f3f-8940-7b6a1c263367: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37d14f33-b5a4-4f3f-8940-7b6a1c263367', 'volume_size': 1} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1397145217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d14f33-b5a4-4f3f-8940-7b6a1c263367,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='92f194d325924bb2b41ce787c90bd59f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:15:33Z,use_quota=True,user_id='8a13992f8fac4d8eb78626038a70f046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Creating volume 37d14f33-b5a4-4f3f-8940-7b6a1c263367 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:15:33 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-37d14f33-b5a4-4f3f-8940-7b6a1c263367 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04d3604-11ff-412e-94c3-a52e467ef718]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:15:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f96268e8-0c39-4027-8613-f1ea1e61056c tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:33 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-37d14f33-b5a4-4f3f-8940-7b6a1c263367 1073741824 Jun 30 16:15:33 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:33 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f Jun 30 16:15:33 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:34 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f96268e8-0c39-4027-8613-f1ea1e61056c tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f" returned: 0 in 1.202s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-f96268e8-0c39-4027-8613-f1ea1e61056c tempest-VolumesSnapshotListTestJSON-1665070985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-384d3cd4-0824-4437-89e1-58dbd06c7b15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:15:34 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b52c1c-ad23-4538-8756-6e26f81c6f44]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:15:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f96268e8-0c39-4027-8613-f1ea1e61056c tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:34 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.707s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:34 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:15:34 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:15:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 28 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:15:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:15:34 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69 Jun 30 16:15:34 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:35 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-37d14f33-b5a4-4f3f-8940-7b6a1c263367 1073741824" returned: 0 in 1.582s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-37d14f33-b5a4-4f3f-8940-7b6a1c263367 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:35 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-37d14f33-b5a4-4f3f-8940-7b6a1c263367 Jun 30 16:15:35 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:36 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f96268e8-0c39-4027-8613-f1ea1e61056c tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69" returned: 0 in 1.271s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-f96268e8-0c39-4027-8613-f1ea1e61056c tempest-VolumesSnapshotListTestJSON-1665070985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-384d3cd4-0824-4437-89e1-58dbd06c7b15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:15:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f96268e8-0c39-4027-8613-f1ea1e61056c tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:36 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f Jun 30 16:15:36 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:36 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-37d14f33-b5a4-4f3f-8940-7b6a1c263367" returned: 0 in 1.338s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] <== create_volume: return (3006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:15:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e380810-b8b7-40b5-974b-bf3e5658bc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37d14f33-b5a4-4f3f-8940-7b6a1c263367', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb4e74a-51b8-4c9d-9250-38582d5497e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:36 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Volume volume-37d14f33-b5a4-4f3f-8940-7b6a1c263367 (37d14f33-b5a4-4f3f-8940-7b6a1c263367): created successfully Jun 30 16:15:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb4e74a-51b8-4c9d-9250-38582d5497e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Flow 'volume_create_manager' (7c9c9c52-1dc5-4b97-86db-57a2b1663a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:15:36 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-84b17281-c20e-47bb-88b5-a156243d48ef tempest-VolumesListTestJSON-589206054 None] Created volume successfully. Jun 30 16:15:37 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f96268e8-0c39-4027-8613-f1ea1e61056c tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f" returned: 0 in 1.034s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f96268e8-0c39-4027-8613-f1ea1e61056c tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:37 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f Jun 30 16:15:37 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:38 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f96268e8-0c39-4027-8613-f1ea1e61056c tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.4206b382-8290-44a8-9c17-8ac3f2ddaf3f" returned: 0 in 0.972s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f96268e8-0c39-4027-8613-f1ea1e61056c tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "cinder-quobyte-4206b382-8290-44a8-9c17-8ac3f2ddaf3f" released by "_delete_snapshot" :: held 4.705s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f96268e8-0c39-4027-8613-f1ea1e61056c tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "cinder-quobyte-384d3cd4-0824-4437-89e1-58dbd06c7b15" released by "delete_snapshot" :: held 4.808s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-f96268e8-0c39-4027-8613-f1ea1e61056c tempest-VolumesSnapshotListTestJSON-1665070985 None] Created reservations ['4fa3c405-35ba-4400-860c-c34c970f8508', 'da0ade8b-a3b1-422e-8962-558722f89a73', '904e7984-4b13-4f2b-81cd-70518f289fc6', 'ccaded05-f136-411f-99e4-fdf68384e537'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Flow 'volume_create_manager' (73468e3c-8a15-4868-9b4a-e0521f39d23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0baa2b03-4b68-40dc-9c90-efdd0e38ffa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0baa2b03-4b68-40dc-9c90-efdd0e38ffa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-286171080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=672fb48a-64cb-4836-bf09-787214e2a85c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='92f194d325924bb2b41ce787c90bd59f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:15:38Z,use_quota=True,user_id='8a13992f8fac4d8eb78626038a70f046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bdf2926-6368-489b-bbb8-59e38db66705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bdf2926-6368-489b-bbb8-59e38db66705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e12456d-7633-4b1d-aa93-cd631caeea87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e12456d-7633-4b1d-aa93-cd631caeea87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '672fb48a-64cb-4836-bf09-787214e2a85c', 'volume_name': 'volume-672fb48a-64cb-4836-bf09-787214e2a85c', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de39ca87-ad75-4d0e-891f-c2fc2c66d60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de39ca87-ad75-4d0e-891f-c2fc2c66d60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e646c82-8bf1-432c-bd36-3c14bf644b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:38 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Volume 672fb48a-64cb-4836-bf09-787214e2a85c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-672fb48a-64cb-4836-bf09-787214e2a85c', 'volume_size': 1} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-286171080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=672fb48a-64cb-4836-bf09-787214e2a85c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='92f194d325924bb2b41ce787c90bd59f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:15:38Z,use_quota=True,user_id='8a13992f8fac4d8eb78626038a70f046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Creating volume 672fb48a-64cb-4836-bf09-787214e2a85c {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:15:38 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-672fb48a-64cb-4836-bf09-787214e2a85c 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:38 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-672fb48a-64cb-4836-bf09-787214e2a85c 1073741824 Jun 30 16:15:38 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:38 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-f96268e8-0c39-4027-8613-f1ea1e61056c tempest-VolumesSnapshotListTestJSON-1665070985 None] Delete snapshot completed successfully. Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f96268e8-0c39-4027-8613-f1ea1e61056c tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "cinder-4206b382-8290-44a8-9c17-8ac3f2ddaf3f-delete_snapshot" released by "delete_snapshot" :: held 5.125s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cfd80941-ebb8-4d57-a0aa-32b62491c497 tempest-VolumesSnapshotListTestJSON-1665070985 None] Acquiring lock "cinder-9ea2e277-fd7c-4309-92e2-818c49497d69-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cfd80941-ebb8-4d57-a0aa-32b62491c497 tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "cinder-9ea2e277-fd7c-4309-92e2-818c49497d69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cfd80941-ebb8-4d57-a0aa-32b62491c497 tempest-VolumesSnapshotListTestJSON-1665070985 None] Acquiring lock "cinder-quobyte-384d3cd4-0824-4437-89e1-58dbd06c7b15" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cfd80941-ebb8-4d57-a0aa-32b62491c497 tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "cinder-quobyte-384d3cd4-0824-4437-89e1-58dbd06c7b15" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cfd80941-ebb8-4d57-a0aa-32b62491c497 tempest-VolumesSnapshotListTestJSON-1665070985 None] Acquiring lock "cinder-quobyte-9ea2e277-fd7c-4309-92e2-818c49497d69" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cfd80941-ebb8-4d57-a0aa-32b62491c497 tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "cinder-quobyte-9ea2e277-fd7c-4309-92e2-818c49497d69" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-cfd80941-ebb8-4d57-a0aa-32b62491c497 tempest-VolumesSnapshotListTestJSON-1665070985 None] Deleting offline snapshot 9ea2e277-fd7c-4309-92e2-818c49497d69 of volume 384d3cd4-0824-4437-89e1-58dbd06c7b15 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-cfd80941-ebb8-4d57-a0aa-32b62491c497 tempest-VolumesSnapshotListTestJSON-1665070985 None] snapshot_file for this snap is: volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f75fee-a235-447e-8b30-c96285b33223]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:15:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cfd80941-ebb8-4d57-a0aa-32b62491c497 tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:38 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69 Jun 30 16:15:38 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:39 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-672fb48a-64cb-4836-bf09-787214e2a85c 1073741824" returned: 0 in 1.144s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-672fb48a-64cb-4836-bf09-787214e2a85c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:39 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-672fb48a-64cb-4836-bf09-787214e2a85c Jun 30 16:15:39 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:39 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cfd80941-ebb8-4d57-a0aa-32b62491c497 tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69" returned: 0 in 1.110s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-cfd80941-ebb8-4d57-a0aa-32b62491c497 tempest-VolumesSnapshotListTestJSON-1665070985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-384d3cd4-0824-4437-89e1-58dbd06c7b15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:15:39 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51533b4-da1e-4d8d-a667-8a9bf35d63ab]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:15:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cfd80941-ebb8-4d57-a0aa-32b62491c497 tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:40 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15 Jun 30 16:15:40 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:40 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-672fb48a-64cb-4836-bf09-787214e2a85c" returned: 0 in 0.879s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] <== create_volume: return (2092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:15:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.095s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e646c82-8bf1-432c-bd36-3c14bf644b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-672fb48a-64cb-4836-bf09-787214e2a85c', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8c8e63-2d19-4fb4-815a-6c9a8abc119c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:40 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Volume volume-672fb48a-64cb-4836-bf09-787214e2a85c (672fb48a-64cb-4836-bf09-787214e2a85c): created successfully Jun 30 16:15:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8c8e63-2d19-4fb4-815a-6c9a8abc119c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Flow 'volume_create_manager' (73468e3c-8a15-4868-9b4a-e0521f39d23d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:15:40 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-b7d08b52-11cd-49ed-8bd5-696e70d3f8df tempest-VolumesListTestJSON-589206054 None] Created volume successfully. Jun 30 16:15:40 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cfd80941-ebb8-4d57-a0aa-32b62491c497 tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15" returned: 0 in 1.008s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cfd80941-ebb8-4d57-a0aa-32b62491c497 tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:40 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69 Jun 30 16:15:40 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:41 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cfd80941-ebb8-4d57-a0aa-32b62491c497 tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69" returned: 0 in 1.112s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cfd80941-ebb8-4d57-a0aa-32b62491c497 tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:41 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69 Jun 30 16:15:41 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:42 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cfd80941-ebb8-4d57-a0aa-32b62491c497 tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15.9ea2e277-fd7c-4309-92e2-818c49497d69" returned: 0 in 0.945s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:43 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cfd80941-ebb8-4d57-a0aa-32b62491c497 tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "cinder-quobyte-9ea2e277-fd7c-4309-92e2-818c49497d69" released by "_delete_snapshot" :: held 4.368s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:43 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cfd80941-ebb8-4d57-a0aa-32b62491c497 tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "cinder-quobyte-384d3cd4-0824-4437-89e1-58dbd06c7b15" released by "delete_snapshot" :: held 4.413s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:43 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-cfd80941-ebb8-4d57-a0aa-32b62491c497 tempest-VolumesSnapshotListTestJSON-1665070985 None] Created reservations ['bb8c7e39-fa30-4255-9b64-c1f1952458d5', '92b58c86-3716-4bbc-9e0a-fec82d948db6', '6a334157-0bb6-4f54-8ee7-87007805fc76', 'a18265a3-ce16-4e93-90dd-2a1d608840d2'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:15:43 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-cfd80941-ebb8-4d57-a0aa-32b62491c497 tempest-VolumesSnapshotListTestJSON-1665070985 None] Delete snapshot completed successfully. Jun 30 16:15:43 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cfd80941-ebb8-4d57-a0aa-32b62491c497 tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "cinder-9ea2e277-fd7c-4309-92e2-818c49497d69-delete_snapshot" released by "delete_snapshot" :: held 4.646s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:44 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-18d9f41b-a9ae-48a0-a83a-c653342d081d tempest-VolumesSnapshotListTestJSON-1665070985 None] Acquiring lock "cinder-384d3cd4-0824-4437-89e1-58dbd06c7b15-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:44 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-18d9f41b-a9ae-48a0-a83a-c653342d081d tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "cinder-384d3cd4-0824-4437-89e1-58dbd06c7b15-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:44 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-18d9f41b-a9ae-48a0-a83a-c653342d081d tempest-VolumesSnapshotListTestJSON-1665070985 None] Acquiring lock "cinder-quobyte-384d3cd4-0824-4437-89e1-58dbd06c7b15" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:44 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-18d9f41b-a9ae-48a0-a83a-c653342d081d tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "cinder-quobyte-384d3cd4-0824-4437-89e1-58dbd06c7b15" acquired by "delete_volume" :: waited 0.028s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:44 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b04ba8b-24ac-4d74-b73e-11db65f8f41a]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:15:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-18d9f41b-a9ae-48a0-a83a-c653342d081d tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:44 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15 Jun 30 16:15:44 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:44 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-80f09641-c50b-4be0-9b5f-3ec8d5476d8e tempest-VolumesListTestJSON-589206054 None] Acquiring lock "cinder-672fb48a-64cb-4836-bf09-787214e2a85c-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:44 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-80f09641-c50b-4be0-9b5f-3ec8d5476d8e tempest-VolumesListTestJSON-589206054 None] Lock "cinder-672fb48a-64cb-4836-bf09-787214e2a85c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:44 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-80f09641-c50b-4be0-9b5f-3ec8d5476d8e tempest-VolumesListTestJSON-589206054 None] Acquiring lock "cinder-quobyte-672fb48a-64cb-4836-bf09-787214e2a85c" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:44 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-80f09641-c50b-4be0-9b5f-3ec8d5476d8e tempest-VolumesListTestJSON-589206054 None] Lock "cinder-quobyte-672fb48a-64cb-4836-bf09-787214e2a85c" acquired by "delete_volume" :: waited 0.025s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:44 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af59a70-d74c-448c-8a09-633468fe47e8]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:15:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-80f09641-c50b-4be0-9b5f-3ec8d5476d8e tempest-VolumesListTestJSON-589206054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-672fb48a-64cb-4836-bf09-787214e2a85c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:45 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-672fb48a-64cb-4836-bf09-787214e2a85c Jun 30 16:15:45 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:45 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-18d9f41b-a9ae-48a0-a83a-c653342d081d tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15" returned: 0 in 1.088s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-18d9f41b-a9ae-48a0-a83a-c653342d081d tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:45 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15 Jun 30 16:15:45 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:45 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-80f09641-c50b-4be0-9b5f-3ec8d5476d8e tempest-VolumesListTestJSON-589206054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-672fb48a-64cb-4836-bf09-787214e2a85c" returned: 0 in 1.084s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-80f09641-c50b-4be0-9b5f-3ec8d5476d8e tempest-VolumesListTestJSON-589206054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-672fb48a-64cb-4836-bf09-787214e2a85c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:46 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-672fb48a-64cb-4836-bf09-787214e2a85c Jun 30 16:15:46 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:46 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-18d9f41b-a9ae-48a0-a83a-c653342d081d tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-384d3cd4-0824-4437-89e1-58dbd06c7b15" returned: 0 in 0.890s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:46 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-18d9f41b-a9ae-48a0-a83a-c653342d081d tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "cinder-quobyte-384d3cd4-0824-4437-89e1-58dbd06c7b15" released by "delete_volume" :: held 2.084s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:46 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-18d9f41b-a9ae-48a0-a83a-c653342d081d tempest-VolumesSnapshotListTestJSON-1665070985 None] Created reservations ['29406617-996f-41ac-ac88-fb193a3e732e', '13731268-8a1b-4033-9bcc-fa66a00f7587', '0f2101c8-29c9-499f-a798-a643b1c1a187', 'd13fc833-7d01-4552-aee4-cce91c7671c9'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:15:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-18d9f41b-a9ae-48a0-a83a-c653342d081d tempest-VolumesSnapshotListTestJSON-1665070985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:15:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-18d9f41b-a9ae-48a0-a83a-c653342d081d tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:15:46 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-18d9f41b-a9ae-48a0-a83a-c653342d081d tempest-VolumesSnapshotListTestJSON-1665070985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:15:46 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-18d9f41b-a9ae-48a0-a83a-c653342d081d tempest-VolumesSnapshotListTestJSON-1665070985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:15:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-18d9f41b-a9ae-48a0-a83a-c653342d081d tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-18d9f41b-a9ae-48a0-a83a-c653342d081d tempest-VolumesSnapshotListTestJSON-1665070985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:46 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:15:46 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:46 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-80f09641-c50b-4be0-9b5f-3ec8d5476d8e tempest-VolumesListTestJSON-589206054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-672fb48a-64cb-4836-bf09-787214e2a85c" returned: 0 in 0.931s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:46 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-80f09641-c50b-4be0-9b5f-3ec8d5476d8e tempest-VolumesListTestJSON-589206054 None] Lock "cinder-quobyte-672fb48a-64cb-4836-bf09-787214e2a85c" released by "delete_volume" :: held 2.074s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:47 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-80f09641-c50b-4be0-9b5f-3ec8d5476d8e tempest-VolumesListTestJSON-589206054 None] Created reservations ['59614c12-bfa9-4a3e-8e27-7e3a7de794d2', 'aee94ba7-da12-4a40-a205-21567f3d8c8f', 'bffe6bff-a3ab-4add-99e5-24443205d974', 'eff2ec52-174e-413d-a427-40eacdf9e9e2'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:15:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-80f09641-c50b-4be0-9b5f-3ec8d5476d8e tempest-VolumesListTestJSON-589206054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:15:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-80f09641-c50b-4be0-9b5f-3ec8d5476d8e tempest-VolumesListTestJSON-589206054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:15:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-80f09641-c50b-4be0-9b5f-3ec8d5476d8e tempest-VolumesListTestJSON-589206054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:15:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-80f09641-c50b-4be0-9b5f-3ec8d5476d8e tempest-VolumesListTestJSON-589206054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:15:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-80f09641-c50b-4be0-9b5f-3ec8d5476d8e tempest-VolumesListTestJSON-589206054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-80f09641-c50b-4be0-9b5f-3ec8d5476d8e tempest-VolumesListTestJSON-589206054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:47 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:15:47 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:47 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-18d9f41b-a9ae-48a0-a83a-c653342d081d tempest-VolumesSnapshotListTestJSON-1665070985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.912s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:47 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-18d9f41b-a9ae-48a0-a83a-c653342d081d tempest-VolumesSnapshotListTestJSON-1665070985 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:15:47 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-18d9f41b-a9ae-48a0-a83a-c653342d081d tempest-VolumesSnapshotListTestJSON-1665070985 None] Deleted volume successfully. Jun 30 16:15:47 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-18d9f41b-a9ae-48a0-a83a-c653342d081d tempest-VolumesSnapshotListTestJSON-1665070985 None] Lock "cinder-384d3cd4-0824-4437-89e1-58dbd06c7b15-delete_volume" released by "delete_volume" :: held 3.350s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:48 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-80f09641-c50b-4be0-9b5f-3ec8d5476d8e tempest-VolumesListTestJSON-589206054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.991s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:48 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-80f09641-c50b-4be0-9b5f-3ec8d5476d8e tempest-VolumesListTestJSON-589206054 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:15:48 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-80f09641-c50b-4be0-9b5f-3ec8d5476d8e tempest-VolumesListTestJSON-589206054 None] Deleted volume successfully. Jun 30 16:15:48 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:UPDATE=82,cinder:SELECT=66,cinder:INSERT=23,cinder:DELETE=8 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:15:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-80f09641-c50b-4be0-9b5f-3ec8d5476d8e tempest-VolumesListTestJSON-589206054 None] Lock "cinder-672fb48a-64cb-4836-bf09-787214e2a85c-delete_volume" released by "delete_volume" :: held 3.402s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4698f0f8-098a-4993-856d-2a90c1963c71 tempest-VolumesListTestJSON-589206054 None] Acquiring lock "cinder-37d14f33-b5a4-4f3f-8940-7b6a1c263367-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4698f0f8-098a-4993-856d-2a90c1963c71 tempest-VolumesListTestJSON-589206054 None] Lock "cinder-37d14f33-b5a4-4f3f-8940-7b6a1c263367-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4698f0f8-098a-4993-856d-2a90c1963c71 tempest-VolumesListTestJSON-589206054 None] Acquiring lock "cinder-quobyte-37d14f33-b5a4-4f3f-8940-7b6a1c263367" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4698f0f8-098a-4993-856d-2a90c1963c71 tempest-VolumesListTestJSON-589206054 None] Lock "cinder-quobyte-37d14f33-b5a4-4f3f-8940-7b6a1c263367" acquired by "delete_volume" :: waited 0.029s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:48 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1fb5e8-04a2-4bf1-ad74-0bb1b0817e53]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:15:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4698f0f8-098a-4993-856d-2a90c1963c71 tempest-VolumesListTestJSON-589206054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-37d14f33-b5a4-4f3f-8940-7b6a1c263367 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:48 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-37d14f33-b5a4-4f3f-8940-7b6a1c263367 Jun 30 16:15:48 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:49 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4698f0f8-098a-4993-856d-2a90c1963c71 tempest-VolumesListTestJSON-589206054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-37d14f33-b5a4-4f3f-8940-7b6a1c263367" returned: 0 in 1.110s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4698f0f8-098a-4993-856d-2a90c1963c71 tempest-VolumesListTestJSON-589206054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-37d14f33-b5a4-4f3f-8940-7b6a1c263367 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:49 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-37d14f33-b5a4-4f3f-8940-7b6a1c263367 Jun 30 16:15:49 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:50 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4698f0f8-098a-4993-856d-2a90c1963c71 tempest-VolumesListTestJSON-589206054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-37d14f33-b5a4-4f3f-8940-7b6a1c263367" returned: 0 in 0.788s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4698f0f8-098a-4993-856d-2a90c1963c71 tempest-VolumesListTestJSON-589206054 None] Lock "cinder-quobyte-37d14f33-b5a4-4f3f-8940-7b6a1c263367" released by "delete_volume" :: held 1.960s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:50 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-4698f0f8-098a-4993-856d-2a90c1963c71 tempest-VolumesListTestJSON-589206054 None] Created reservations ['37574de5-c1d3-40a2-a86d-c81f14c1c4d7', '37abbc67-00c2-4663-865a-f6c17914a65d', 'eec26a00-c312-43b3-b953-d60cd8e6ca5a', 'b5d887a4-b07b-4b44-b6b1-28b3787782d2'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:15:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4698f0f8-098a-4993-856d-2a90c1963c71 tempest-VolumesListTestJSON-589206054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:15:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4698f0f8-098a-4993-856d-2a90c1963c71 tempest-VolumesListTestJSON-589206054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:15:50 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-4698f0f8-098a-4993-856d-2a90c1963c71 tempest-VolumesListTestJSON-589206054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:15:50 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-4698f0f8-098a-4993-856d-2a90c1963c71 tempest-VolumesListTestJSON-589206054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:15:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4698f0f8-098a-4993-856d-2a90c1963c71 tempest-VolumesListTestJSON-589206054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4698f0f8-098a-4993-856d-2a90c1963c71 tempest-VolumesListTestJSON-589206054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:50 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:15:50 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-16b7aef1-b672-4095-8595-5ea96ac2a5b2 tempest-VolumesListTestJSON-589206054 None] Acquiring lock "cinder-a6d0c305-19a5-4002-bfcf-e728783ff41a-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-16b7aef1-b672-4095-8595-5ea96ac2a5b2 tempest-VolumesListTestJSON-589206054 None] Lock "cinder-a6d0c305-19a5-4002-bfcf-e728783ff41a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-16b7aef1-b672-4095-8595-5ea96ac2a5b2 tempest-VolumesListTestJSON-589206054 None] Acquiring lock "cinder-quobyte-a6d0c305-19a5-4002-bfcf-e728783ff41a" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:15:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-16b7aef1-b672-4095-8595-5ea96ac2a5b2 tempest-VolumesListTestJSON-589206054 None] Lock "cinder-quobyte-a6d0c305-19a5-4002-bfcf-e728783ff41a" acquired by "delete_volume" :: waited 0.027s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:15:51 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7244bf6-500e-4209-9400-b87b3ac9e03a]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:15:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-16b7aef1-b672-4095-8595-5ea96ac2a5b2 tempest-VolumesListTestJSON-589206054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6d0c305-19a5-4002-bfcf-e728783ff41a {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:51 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6d0c305-19a5-4002-bfcf-e728783ff41a Jun 30 16:15:51 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:51 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4698f0f8-098a-4993-856d-2a90c1963c71 tempest-VolumesListTestJSON-589206054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.080s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:51 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-4698f0f8-098a-4993-856d-2a90c1963c71 tempest-VolumesListTestJSON-589206054 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:15:51 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-4698f0f8-098a-4993-856d-2a90c1963c71 tempest-VolumesListTestJSON-589206054 None] Deleted volume successfully. Jun 30 16:15:51 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4698f0f8-098a-4993-856d-2a90c1963c71 tempest-VolumesListTestJSON-589206054 None] Lock "cinder-37d14f33-b5a4-4f3f-8940-7b6a1c263367-delete_volume" released by "delete_volume" :: held 3.348s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:51 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-16b7aef1-b672-4095-8595-5ea96ac2a5b2 tempest-VolumesListTestJSON-589206054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6d0c305-19a5-4002-bfcf-e728783ff41a" returned: 0 in 0.948s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-16b7aef1-b672-4095-8595-5ea96ac2a5b2 tempest-VolumesListTestJSON-589206054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6d0c305-19a5-4002-bfcf-e728783ff41a {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:52 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6d0c305-19a5-4002-bfcf-e728783ff41a Jun 30 16:15:52 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:53 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-16b7aef1-b672-4095-8595-5ea96ac2a5b2 tempest-VolumesListTestJSON-589206054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6d0c305-19a5-4002-bfcf-e728783ff41a" returned: 0 in 1.091s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:53 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-16b7aef1-b672-4095-8595-5ea96ac2a5b2 tempest-VolumesListTestJSON-589206054 None] Lock "cinder-quobyte-a6d0c305-19a5-4002-bfcf-e728783ff41a" released by "delete_volume" :: held 2.152s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:53 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-16b7aef1-b672-4095-8595-5ea96ac2a5b2 tempest-VolumesListTestJSON-589206054 None] Created reservations ['40c5825e-fbfd-4964-8f44-6052eeb1f49c', '0a99d041-3fea-43c7-a8ba-6a589a554221', 'aa543cef-f3a1-4079-ad42-98d6f581102e', '6fbd138d-7b5d-478b-9c3e-ea957244ca89'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:15:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-16b7aef1-b672-4095-8595-5ea96ac2a5b2 tempest-VolumesListTestJSON-589206054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:15:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-16b7aef1-b672-4095-8595-5ea96ac2a5b2 tempest-VolumesListTestJSON-589206054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:15:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-16b7aef1-b672-4095-8595-5ea96ac2a5b2 tempest-VolumesListTestJSON-589206054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:15:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-16b7aef1-b672-4095-8595-5ea96ac2a5b2 tempest-VolumesListTestJSON-589206054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:15:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-16b7aef1-b672-4095-8595-5ea96ac2a5b2 tempest-VolumesListTestJSON-589206054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:15:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-16b7aef1-b672-4095-8595-5ea96ac2a5b2 tempest-VolumesListTestJSON-589206054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:53 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:15:53 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:15:54 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Jun 30 16:15:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-16b7aef1-b672-4095-8595-5ea96ac2a5b2 tempest-VolumesListTestJSON-589206054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.289s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:15:54 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-16b7aef1-b672-4095-8595-5ea96ac2a5b2 tempest-VolumesListTestJSON-589206054 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:15:54 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-16b7aef1-b672-4095-8595-5ea96ac2a5b2 tempest-VolumesListTestJSON-589206054 None] Deleted volume successfully. Jun 30 16:15:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-16b7aef1-b672-4095-8595-5ea96ac2a5b2 tempest-VolumesListTestJSON-589206054 None] Lock "cinder-a6d0c305-19a5-4002-bfcf-e728783ff41a-delete_volume" released by "delete_volume" :: held 3.910s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:15:58 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=87,cinder:UPDATE=104,cinder:DELETE=6,cinder:INSERT=25 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:15:58 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:15:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Flow 'volume_create_manager' (02c03093-8e92-4233-9d5c-e7462ce805df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:15:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a28f43b-bfd2-47a4-ae37-6579130a54de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a28f43b-bfd2-47a4-ae37-6579130a54de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f583949-b7f0-4871-8c48-39db10403dda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49f0cabe99a5413381b91168ebbd46cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:15:58Z,use_quota=True,user_id='8c588b3e8e6c46b0af6477f9e296747a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74fbab3b-4ac2-4159-acda-ff30012c6b81),volume_type_id=74fbab3b-4ac2-4159-acda-ff30012c6b81)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc60128-1f6d-42cf-8396-e31be684f5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc60128-1f6d-42cf-8396-e31be684f5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d826fd-3a2f-438d-bb45-36e7dfa2809f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:58 devstack cinder-volume[93781]: DEBUG cinder.image.glance [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Creating Keystone auth plugin from conf {{(pid=93781) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 30 16:15:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d826fd-3a2f-438d-bb45-36e7dfa2809f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3f583949-b7f0-4871-8c48-39db10403dda', 'volume_name': 'volume-3f583949-b7f0-4871-8c48-39db10403dda', 'volume_size': 1, 'image_id': '557ec7fb-6c55-40cf-ba91-3672ca0c5e34', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/557ec7fb-6c55-40cf-ba91-3672ca0c5e34', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4165bb31d59e222bb349fc5c189215fa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '49f0cabe99a5413381b91168ebbd46cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a1a0ec0da8a84a6fa3de8d75675fc06265c8fb3b46e0347706f48b7b8c439cd1fa8e847290dcc8768cb8a63fa502090f6d231b5fafd48fa4587370700ee8dc4', 'id': '557ec7fb-6c55-40cf-ba91-3672ca0c5e34', 'created_at': datetime.datetime(2026, 6, 30, 14, 15, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 14, 15, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/557ec7fb-6c55-40cf-ba91-3672ca0c5e34/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7439200a-cd4d-4dad-b7c5-62a639dbf3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7439200a-cd4d-4dad-b7c5-62a639dbf3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:15:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911618ac-703d-44d7-bffb-5b526020d546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:15:58 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Volume 3f583949-b7f0-4871-8c48-39db10403dda: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3f583949-b7f0-4871-8c48-39db10403dda', 'volume_size': 1, 'image_id': '557ec7fb-6c55-40cf-ba91-3672ca0c5e34', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/557ec7fb-6c55-40cf-ba91-3672ca0c5e34', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4165bb31d59e222bb349fc5c189215fa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '49f0cabe99a5413381b91168ebbd46cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a1a0ec0da8a84a6fa3de8d75675fc06265c8fb3b46e0347706f48b7b8c439cd1fa8e847290dcc8768cb8a63fa502090f6d231b5fafd48fa4587370700ee8dc4', 'id': '557ec7fb-6c55-40cf-ba91-3672ca0c5e34', 'created_at': datetime.datetime(2026, 6, 30, 14, 15, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 14, 15, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/557ec7fb-6c55-40cf-ba91-3672ca0c5e34/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 30 16:15:58 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Trying to clone 3f583949-b7f0-4871-8c48-39db10403dda from image 557ec7fb-6c55-40cf-ba91-3672ca0c5e34 at location (None, [{'url': 'file:///opt/stack/data/glance/images/557ec7fb-6c55-40cf-ba91-3672ca0c5e34', 'metadata': {}}]). {{(pid=93781) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 30 16:15:58 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 30 16:15:58 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Image download 0.00 MB at 0.00 MB/s Jun 30 16:15:59 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c8e13b-b405-498a-8194-694ca9b690de]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:15:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:15:59 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD Jun 30 16:15:59 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:00 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD" returned: 0 in 0.980s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:00 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD Jun 30 16:16:00 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:01 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD" returned: 1 in 1.036s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:16:01 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Temporary image 557ec7fb-6c55-40cf-ba91-3672ca0c5e34 is fetched for user 8c588b3e8e6c46b0af6477f9e296747a. {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 30 16:16:01 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5d5c50-f374-47dd-8f4c-d4ab17db5dbf]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:16:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:01 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD Jun 30 16:16:01 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:02 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD" returned: 0 in 0.991s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:02 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD Jun 30 16:16:02 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:03 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:16:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Flow 'volume_create_manager' (aa3918fb-8933-4c39-859b-f4790f94a766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:16:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05097ad8-1f41-4ebd-ada8-1fab49c7fde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05097ad8-1f41-4ebd-ada8-1fab49c7fde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4f24f6-d8d5-479b-86c1-e95cba7d1222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5faddb2f6075424aa2d8cc53410c5fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:16:03Z,use_quota=True,user_id='9b9d2e7099e34cc3b444a41fab5d5745',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8631cd8-df8c-422c-a354-d0453700cee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8631cd8-df8c-422c-a354-d0453700cee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0316f79-06f3-4f49-840d-9ddd7da963aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:03 devstack cinder-volume[93781]: DEBUG cinder.image.glance [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Creating Keystone auth plugin from conf {{(pid=93781) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 30 16:16:03 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD" returned: 1 in 1.244s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:16:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f583949-b7f0-4871-8c48-39db10403dda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49f0cabe99a5413381b91168ebbd46cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:15:58Z,use_quota=True,user_id='8c588b3e8e6c46b0af6477f9e296747a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74fbab3b-4ac2-4159-acda-ff30012c6b81),volume_type_id=74fbab3b-4ac2-4159-acda-ff30012c6b81)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:16:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Creating volume 3f583949-b7f0-4871-8c48-39db10403dda {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:16:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:16:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:16:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:16:03 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:16:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:03 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda 1073741824 Jun 30 16:16:03 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:04 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0316f79-06f3-4f49-840d-9ddd7da963aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bc4f24f6-d8d5-479b-86c1-e95cba7d1222', 'volume_name': 'volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222', 'volume_size': 1, 'image_id': '1e165da6-2e4f-40b1-a2e6-1354f279b588', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e165da6-2e4f-40b1-a2e6-1354f279b588', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7ba8cfa842afbbbf89e47ef64c5d8c03', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5faddb2f6075424aa2d8cc53410c5fe2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f04b13e56d167186baf6129ae33d9c9f96a60b07627a38f293781d8ce52a30b9dc601ec7d3d20e824e589fb89986843497ab553de6f10c4bdbd496d49334fe1', 'id': '1e165da6-2e4f-40b1-a2e6-1354f279b588', 'created_at': datetime.datetime(2026, 6, 30, 14, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 14, 16, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e165da6-2e4f-40b1-a2e6-1354f279b588/file', 'properties': {}}, 'image_service': }' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:04 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e877ca-f178-48d5-a450-1ad8c9037ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:04 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e877ca-f178-48d5-a450-1ad8c9037ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:04 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaed6d96-9e37-427a-8f45-bd5cccb45e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:04 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Volume bc4f24f6-d8d5-479b-86c1-e95cba7d1222: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222', 'volume_size': 1, 'image_id': '1e165da6-2e4f-40b1-a2e6-1354f279b588', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e165da6-2e4f-40b1-a2e6-1354f279b588', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7ba8cfa842afbbbf89e47ef64c5d8c03', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5faddb2f6075424aa2d8cc53410c5fe2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f04b13e56d167186baf6129ae33d9c9f96a60b07627a38f293781d8ce52a30b9dc601ec7d3d20e824e589fb89986843497ab553de6f10c4bdbd496d49334fe1', 'id': '1e165da6-2e4f-40b1-a2e6-1354f279b588', 'created_at': datetime.datetime(2026, 6, 30, 14, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 14, 16, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e165da6-2e4f-40b1-a2e6-1354f279b588/file', 'properties': {}}, 'image_service': } Jun 30 16:16:04 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Trying to clone bc4f24f6-d8d5-479b-86c1-e95cba7d1222 from image 1e165da6-2e4f-40b1-a2e6-1354f279b588 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1e165da6-2e4f-40b1-a2e6-1354f279b588', 'metadata': {}}]). {{(pid=93781) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 30 16:16:04 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 30 16:16:04 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Image download 0.00 MB at 0.00 MB/s Jun 30 16:16:04 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[730ef157-435c-4163-966c-5fea334365e9]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:16:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:04 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD Jun 30 16:16:04 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:05 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda 1073741824" returned: 0 in 1.756s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:05 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda Jun 30 16:16:05 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:06 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD" returned: 0 in 1.581s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:06 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD Jun 30 16:16:06 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:06 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda" returned: 0 in 1.201s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] <== create_volume: return (3080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:16:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.100s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:06 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Attempting download of 557ec7fb-6c55-40cf-ba91-3672ca0c5e34 ((None, [{'url': 'file:///opt/stack/data/glance/images/557ec7fb-6c55-40cf-ba91-3672ca0c5e34', 'metadata': {}}])) to volume 3f583949-b7f0-4871-8c48-39db10403dda. {{(pid=93781) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 30 16:16:06 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4764150-5a2c-429b-8e0c-cb8384afc8db]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:16:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_3n75jcqu {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:06 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_3n75jcqu Jun 30 16:16:06 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:07 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD" returned: 1 in 1.299s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:16:07 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Temporary image 1e165da6-2e4f-40b1-a2e6-1354f279b588 is fetched for user 9b9d2e7099e34cc3b444a41fab5d5745. {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 30 16:16:07 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[1317ffcf-c089-410f-928a-ef86528a1b75]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:16:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:07 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_3n75jcqu" returned: 0 in 1.385s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_3n75jcqu {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:08 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD Jun 30 16:16:08 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:08 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_3n75jcqu Jun 30 16:16:08 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:08 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD" returned: 0 in 1.147s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:09 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD Jun 30 16:16:09 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:09 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_3n75jcqu" returned: 1 in 1.327s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_3n75jcqu' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:16:09 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31e08b8-aa3e-483a-a539-6ba9c3698db8]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:16:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:09 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD Jun 30 16:16:09 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:10 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD" returned: 0 in 0.998s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:10 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD" returned: 1 in 1.446s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:16:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4f24f6-d8d5-479b-86c1-e95cba7d1222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5faddb2f6075424aa2d8cc53410c5fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:16:03Z,use_quota=True,user_id='9b9d2e7099e34cc3b444a41fab5d5745',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:16:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Creating volume bc4f24f6-d8d5-479b-86c1-e95cba7d1222 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:16:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:16:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:16:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:16:10 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:16:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:10 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222 1073741824 Jun 30 16:16:10 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:10 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD Jun 30 16:16:10 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:11 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD" returned: 1 in 1.328s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:16:11 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] 557ec7fb-6c55-40cf-ba91-3672ca0c5e34 was raw, converting to raw {{(pid=93781) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 30 16:16:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:11 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda Jun 30 16:16:11 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:11 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222 1073741824" returned: 0 in 1.462s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:11 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222 Jun 30 16:16:11 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:12 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda" returned: 0 in 0.963s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:12 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_557ec7fb-6c55-40cf-ba91-3672ca0c5e34_4hia2otxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:16:12 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Converted 0.00 MB image at 0.00 MB/s Jun 30 16:16:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:12 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda 1G Jun 30 16:16:12 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:12 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222" returned: 0 in 1.106s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:12 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] <== create_volume: return (2652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:16:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.659s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:13 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Attempting download of 1e165da6-2e4f-40b1-a2e6-1354f279b588 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e165da6-2e4f-40b1-a2e6-1354f279b588', 'metadata': {}}])) to volume bc4f24f6-d8d5-479b-86c1-e95cba7d1222. {{(pid=93781) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 30 16:16:13 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[6237ac12-1139-47cb-bf53-c620d9121049]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:16:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e165da6-2e4f-40b1-a2e6-1354f279b588_8ym45r0q {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:13 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e165da6-2e4f-40b1-a2e6-1354f279b588_8ym45r0q Jun 30 16:16:13 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:13 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda 1G" returned: 0 in 0.997s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:13 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb64512-8270-4d19-b326-2d3b21bcf5ed]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:16:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:13 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda Jun 30 16:16:13 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:14 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e165da6-2e4f-40b1-a2e6-1354f279b588_8ym45r0q" returned: 0 in 1.380s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e165da6-2e4f-40b1-a2e6-1354f279b588_8ym45r0q {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:14 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e165da6-2e4f-40b1-a2e6-1354f279b588_8ym45r0q Jun 30 16:16:14 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:15 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda" returned: 0 in 1.548s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:15 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda Jun 30 16:16:15 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:15 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e165da6-2e4f-40b1-a2e6-1354f279b588_8ym45r0q" returned: 1 in 1.230s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e165da6-2e4f-40b1-a2e6-1354f279b588_8ym45r0q' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:16:15 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[64956974-d870-4d45-8f6e-93e415a1d6e3]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:16:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:16 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD Jun 30 16:16:16 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:16 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda" returned: 1 in 1.507s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:16:16 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Downloaded image 557ec7fb-6c55-40cf-ba91-3672ca0c5e34 ((None, [{'url': 'file:///opt/stack/data/glance/images/557ec7fb-6c55-40cf-ba91-3672ca0c5e34', 'metadata': {}}])) to volume 3f583949-b7f0-4871-8c48-39db10403dda successfully. {{(pid=93781) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 30 16:16:16 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Temporary image 557ec7fb-6c55-40cf-ba91-3672ca0c5e34 for user 8c588b3e8e6c46b0af6477f9e296747a is deleted. {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 30 16:16:16 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Marking volume 3f583949-b7f0-4871-8c48-39db10403dda as bootable. {{(pid=93781) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 30 16:16:16 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Copying metadata from image 557ec7fb-6c55-40cf-ba91-3672ca0c5e34 to 3f583949-b7f0-4871-8c48-39db10403dda. {{(pid=93781) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 30 16:16:16 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Creating volume glance metadata for volume 3f583949-b7f0-4871-8c48-39db10403dda backed by image 557ec7fb-6c55-40cf-ba91-3672ca0c5e34 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '557ec7fb-6c55-40cf-ba91-3672ca0c5e34', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4165bb31d59e222bb349fc5c189215fa', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93781) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 30 16:16:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911618ac-703d-44d7-bffb-5b526020d546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f583949-b7f0-4871-8c48-39db10403dda', 'volume_size': 1, 'image_id': '557ec7fb-6c55-40cf-ba91-3672ca0c5e34', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/557ec7fb-6c55-40cf-ba91-3672ca0c5e34', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4165bb31d59e222bb349fc5c189215fa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '49f0cabe99a5413381b91168ebbd46cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a1a0ec0da8a84a6fa3de8d75675fc06265c8fb3b46e0347706f48b7b8c439cd1fa8e847290dcc8768cb8a63fa502090f6d231b5fafd48fa4587370700ee8dc4', 'id': '557ec7fb-6c55-40cf-ba91-3672ca0c5e34', 'created_at': datetime.datetime(2026, 6, 30, 14, 15, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 14, 15, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/557ec7fb-6c55-40cf-ba91-3672ca0c5e34/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf4a0d7-2432-4a5f-9ede-98ca52ee4a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:16 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Volume volume-3f583949-b7f0-4871-8c48-39db10403dda (3f583949-b7f0-4871-8c48-39db10403dda): created successfully Jun 30 16:16:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf4a0d7-2432-4a5f-9ede-98ca52ee4a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Flow 'volume_create_manager' (02c03093-8e92-4233-9d5c-e7462ce805df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:16:16 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-887b6950-b9ec-4c95-9e58-c70958a59f50 tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Created volume successfully. Jun 30 16:16:17 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD" returned: 0 in 1.495s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:17 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD Jun 30 16:16:17 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:18 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Acquiring lock "cinder-3f583949-b7f0-4871-8c48-39db10403dda-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:16:18 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Lock "cinder-3f583949-b7f0-4871-8c48-39db10403dda-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:16:18 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Acquiring lock "cinder-quobyte-3f583949-b7f0-4871-8c48-39db10403dda" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:16:18 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Lock "cinder-quobyte-3f583949-b7f0-4871-8c48-39db10403dda" acquired by "delete_volume" :: waited 0.023s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:16:18 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3e9663-f44f-4636-9549-bc5093d770a8]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:16:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:18 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda Jun 30 16:16:18 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:18 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD" returned: 1 in 1.682s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:16:18 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] 1e165da6-2e4f-40b1-a2e6-1354f279b588 was raw, converting to raw {{(pid=93781) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 30 16:16:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:19 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222 Jun 30 16:16:19 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:19 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda" returned: 0 in 1.137s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:19 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda Jun 30 16:16:19 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:20 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222" returned: 0 in 1.229s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:20 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1e165da6-2e4f-40b1-a2e6-1354f279b588_1czudgz7devstack@QuobyteHD, size 0.00 MB, duration 1.23 sec, destination /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222 {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:16:20 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Converted 0.00 MB image at 0.00 MB/s Jun 30 16:16:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:20 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222 1G Jun 30 16:16:20 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:20 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda" returned: 1 in 1.002s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:16:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:20 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda Jun 30 16:16:20 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:21 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222 1G" returned: 0 in 1.273s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:21 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6ef5ab-6754-4178-8b37-b511ca8aedf8]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:16:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:21 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222 Jun 30 16:16:21 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:21 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3f583949-b7f0-4871-8c48-39db10403dda" returned: 0 in 1.225s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Lock "cinder-quobyte-3f583949-b7f0-4871-8c48-39db10403dda" released by "delete_volume" :: held 3.513s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:16:21 devstack cinder-volume[93781]: WARNING cinder.quota [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:16:21 devstack cinder-volume[93781]: WARNING cinder.quota [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:16:22 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Created reservations ['fff93ed1-0809-4e4a-a696-ae4372e92f63', '5c793916-a594-4280-8a6a-3b33c72f94e9', '7b1e4cc0-a629-499a-a6ed-22b99cefcbcb', 'e434160c-8d33-4326-aa25-5c259b5f734d'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:16:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:22 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:16:22 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:16:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:22 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:16:22 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:22 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222" returned: 0 in 1.079s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:22 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222 Jun 30 16:16:22 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:23 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.933s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:23 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:16:23 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Deleted volume successfully. Jun 30 16:16:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3bc24d20-c4aa-4ab5-bfb1-44194140032c tempest-VolumeAndVolumeTypeFromImageTest-646267815 None] Lock "cinder-3f583949-b7f0-4871-8c48-39db10403dda-delete_volume" released by "delete_volume" :: held 4.953s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:16:23 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222" returned: 1 in 1.072s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:16:23 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Downloaded image 1e165da6-2e4f-40b1-a2e6-1354f279b588 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e165da6-2e4f-40b1-a2e6-1354f279b588', 'metadata': {}}])) to volume bc4f24f6-d8d5-479b-86c1-e95cba7d1222 successfully. {{(pid=93781) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 30 16:16:23 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Temporary image 1e165da6-2e4f-40b1-a2e6-1354f279b588 for user 9b9d2e7099e34cc3b444a41fab5d5745 is deleted. {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 30 16:16:23 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Marking volume bc4f24f6-d8d5-479b-86c1-e95cba7d1222 as bootable. {{(pid=93781) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 30 16:16:23 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Copying metadata from image 1e165da6-2e4f-40b1-a2e6-1354f279b588 to bc4f24f6-d8d5-479b-86c1-e95cba7d1222. {{(pid=93781) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 30 16:16:23 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Creating volume glance metadata for volume bc4f24f6-d8d5-479b-86c1-e95cba7d1222 backed by image 1e165da6-2e4f-40b1-a2e6-1354f279b588 with: {'image_id': '1e165da6-2e4f-40b1-a2e6-1354f279b588', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7ba8cfa842afbbbf89e47ef64c5d8c03', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93781) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 30 16:16:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaed6d96-9e37-427a-8f45-bd5cccb45e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222', 'volume_size': 1, 'image_id': '1e165da6-2e4f-40b1-a2e6-1354f279b588', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e165da6-2e4f-40b1-a2e6-1354f279b588', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7ba8cfa842afbbbf89e47ef64c5d8c03', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5faddb2f6075424aa2d8cc53410c5fe2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f04b13e56d167186baf6129ae33d9c9f96a60b07627a38f293781d8ce52a30b9dc601ec7d3d20e824e589fb89986843497ab553de6f10c4bdbd496d49334fe1', 'id': '1e165da6-2e4f-40b1-a2e6-1354f279b588', 'created_at': datetime.datetime(2026, 6, 30, 14, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 14, 16, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e165da6-2e4f-40b1-a2e6-1354f279b588/file', 'properties': {}}, 'image_service': }' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a41ba9-d063-48e3-b276-23c5c03aefa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:23 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Volume volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222 (bc4f24f6-d8d5-479b-86c1-e95cba7d1222): created successfully Jun 30 16:16:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a41ba9-d063-48e3-b276-23c5c03aefa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Flow 'volume_create_manager' (aa3918fb-8933-4c39-859b-f4790f94a766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:16:23 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-0b1be754-0ed6-44c7-bdef-5d2a707d41ab tempest-VolumeImageDependencyTests-1165883535 None] Created volume successfully. Jun 30 16:16:24 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-bddacc54-43be-4572-a02e-7a300aad96c3 tempest-VolumeImageDependencyTests-1165883535 None] Acquiring lock "cinder-bc4f24f6-d8d5-479b-86c1-e95cba7d1222-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:16:24 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-bddacc54-43be-4572-a02e-7a300aad96c3 tempest-VolumeImageDependencyTests-1165883535 None] Lock "cinder-bc4f24f6-d8d5-479b-86c1-e95cba7d1222-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:16:24 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-bddacc54-43be-4572-a02e-7a300aad96c3 tempest-VolumeImageDependencyTests-1165883535 None] Acquiring lock "cinder-quobyte-bc4f24f6-d8d5-479b-86c1-e95cba7d1222" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:16:24 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-bddacc54-43be-4572-a02e-7a300aad96c3 tempest-VolumeImageDependencyTests-1165883535 None] Lock "cinder-quobyte-bc4f24f6-d8d5-479b-86c1-e95cba7d1222" acquired by "delete_volume" :: waited 0.022s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:16:24 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8655b0b-6e28-4fbf-8086-d2bcc3b31bcd]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:16:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bddacc54-43be-4572-a02e-7a300aad96c3 tempest-VolumeImageDependencyTests-1165883535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:25 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222 Jun 30 16:16:25 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:25 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bddacc54-43be-4572-a02e-7a300aad96c3 tempest-VolumeImageDependencyTests-1165883535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222" returned: 0 in 0.982s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bddacc54-43be-4572-a02e-7a300aad96c3 tempest-VolumeImageDependencyTests-1165883535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:26 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222 Jun 30 16:16:26 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:26 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bddacc54-43be-4572-a02e-7a300aad96c3 tempest-VolumeImageDependencyTests-1165883535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222" returned: 1 in 0.971s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bddacc54-43be-4572-a02e-7a300aad96c3 tempest-VolumeImageDependencyTests-1165883535 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:16:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bddacc54-43be-4572-a02e-7a300aad96c3 tempest-VolumeImageDependencyTests-1165883535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:26 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222 Jun 30 16:16:26 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:27 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bddacc54-43be-4572-a02e-7a300aad96c3 tempest-VolumeImageDependencyTests-1165883535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bc4f24f6-d8d5-479b-86c1-e95cba7d1222" returned: 0 in 0.974s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:27 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-bddacc54-43be-4572-a02e-7a300aad96c3 tempest-VolumeImageDependencyTests-1165883535 None] Lock "cinder-quobyte-bc4f24f6-d8d5-479b-86c1-e95cba7d1222" released by "delete_volume" :: held 3.029s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:16:28 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-bddacc54-43be-4572-a02e-7a300aad96c3 tempest-VolumeImageDependencyTests-1165883535 None] Created reservations ['dd323f6a-7408-40d7-9639-2c55c5e648d9', 'a4fcbafe-7a70-4d45-842d-664500c566c4', 'a91a8b7a-bf8d-4978-9658-8f125ad36b8a', '82becdd0-3827-4dfc-9c11-50d29db52ea1'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:16:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-bddacc54-43be-4572-a02e-7a300aad96c3 tempest-VolumeImageDependencyTests-1165883535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-bddacc54-43be-4572-a02e-7a300aad96c3 tempest-VolumeImageDependencyTests-1165883535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:28 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-bddacc54-43be-4572-a02e-7a300aad96c3 tempest-VolumeImageDependencyTests-1165883535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:16:28 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-bddacc54-43be-4572-a02e-7a300aad96c3 tempest-VolumeImageDependencyTests-1165883535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:16:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-bddacc54-43be-4572-a02e-7a300aad96c3 tempest-VolumeImageDependencyTests-1165883535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bddacc54-43be-4572-a02e-7a300aad96c3 tempest-VolumeImageDependencyTests-1165883535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:28 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:16:28 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:29 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bddacc54-43be-4572-a02e-7a300aad96c3 tempest-VolumeImageDependencyTests-1165883535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.149s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-bddacc54-43be-4572-a02e-7a300aad96c3 tempest-VolumeImageDependencyTests-1165883535 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:16:29 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-bddacc54-43be-4572-a02e-7a300aad96c3 tempest-VolumeImageDependencyTests-1165883535 None] Deleted volume successfully. Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-bddacc54-43be-4572-a02e-7a300aad96c3 tempest-VolumeImageDependencyTests-1165883535 None] Lock "cinder-bc4f24f6-d8d5-479b-86c1-e95cba7d1222-delete_volume" released by "delete_volume" :: held 4.525s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Flow 'volume_create_manager' (230ad19c-19f2-4c6e-b466-af72b002900e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc36921-8c49-4945-97c1-dcdb163e985b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc36921-8c49-4945-97c1-dcdb163e985b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1506865450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=496e0c4f-1532-4752-b2f1-5f9f6185794b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e7bce18c8d74ae79a1742a4214522a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:16:30Z,use_quota=True,user_id='b1a465fe5fd64827a930ae52739aea90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ee8d6f-dbc1-40d7-b9e8-e28866d78beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ee8d6f-dbc1-40d7-b9e8-e28866d78beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96eee38e-5a76-4c1b-872d-29ea6bc7d1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96eee38e-5a76-4c1b-872d-29ea6bc7d1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '496e0c4f-1532-4752-b2f1-5f9f6185794b', 'volume_name': 'volume-496e0c4f-1532-4752-b2f1-5f9f6185794b', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ec54bf-ff08-4133-ada1-04c2d5771725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ec54bf-ff08-4133-ada1-04c2d5771725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a52c20-96f2-4967-aa5c-d4b92e678d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:29 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Volume 496e0c4f-1532-4752-b2f1-5f9f6185794b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-496e0c4f-1532-4752-b2f1-5f9f6185794b', 'volume_size': 1} Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1506865450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=496e0c4f-1532-4752-b2f1-5f9f6185794b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e7bce18c8d74ae79a1742a4214522a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:16:30Z,use_quota=True,user_id='b1a465fe5fd64827a930ae52739aea90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Creating volume 496e0c4f-1532-4752-b2f1-5f9f6185794b {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:16:29 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:16:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-496e0c4f-1532-4752-b2f1-5f9f6185794b 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:29 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-496e0c4f-1532-4752-b2f1-5f9f6185794b 1073741824 Jun 30 16:16:29 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:30 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:16:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Flow 'volume_create_manager' (0b0d604b-44f9-42b3-b771-c426ff997bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:16:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5873b282-78f5-4112-88a3-ace0126f91da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5873b282-78f5-4112-88a3-ace0126f91da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1754525941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4e0bc7-0cad-4d41-baf6-14a97847427e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e7bce18c8d74ae79a1742a4214522a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:16:30Z,use_quota=True,user_id='b1a465fe5fd64827a930ae52739aea90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99243085-d3af-4c23-b08b-aa7d510f3286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99243085-d3af-4c23-b08b-aa7d510f3286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da4aa42-4af2-4c9d-9022-803da2cfa883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da4aa42-4af2-4c9d-9022-803da2cfa883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b4e0bc7-0cad-4d41-baf6-14a97847427e', 'volume_name': 'volume-9b4e0bc7-0cad-4d41-baf6-14a97847427e', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db63d68-46e6-4951-8a8d-7d3262913c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db63d68-46e6-4951-8a8d-7d3262913c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3effa609-9877-4338-a58f-465d277f16b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:30 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Volume 9b4e0bc7-0cad-4d41-baf6-14a97847427e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b4e0bc7-0cad-4d41-baf6-14a97847427e', 'volume_size': 1} Jun 30 16:16:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:31 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-496e0c4f-1532-4752-b2f1-5f9f6185794b 1073741824" returned: 0 in 1.417s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-496e0c4f-1532-4752-b2f1-5f9f6185794b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:31 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-496e0c4f-1532-4752-b2f1-5f9f6185794b Jun 30 16:16:31 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:31 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:16:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Flow 'volume_create_manager' (09abbf9e-49c3-40e5-884f-39393994d461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:16:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c6e2f2-d1f5-4c7e-8b1f-008d517c1eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c6e2f2-d1f5-4c7e-8b1f-008d517c1eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-851589619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=867da2a3-a529-4852-a9e9-86b080e74027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e7bce18c8d74ae79a1742a4214522a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:16:32Z,use_quota=True,user_id='b1a465fe5fd64827a930ae52739aea90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51d1ee5-1e4f-4692-bdde-663d777f99bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51d1ee5-1e4f-4692-bdde-663d777f99bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37666e88-edd6-49e8-abd8-0ea8fe95e31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37666e88-edd6-49e8-abd8-0ea8fe95e31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '867da2a3-a529-4852-a9e9-86b080e74027', 'volume_name': 'volume-867da2a3-a529-4852-a9e9-86b080e74027', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5deeaa5f-37a2-4dc7-9186-e86321f46ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5deeaa5f-37a2-4dc7-9186-e86321f46ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbbd223-7855-4487-adbd-6217fbe1c0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:32 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Volume 867da2a3-a529-4852-a9e9-86b080e74027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-867da2a3-a529-4852-a9e9-86b080e74027', 'volume_size': 1} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Flow 'volume_create_manager' (5300cb40-b6d5-42ba-9b02-440da1df1f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3091ac6-fce6-4022-a487-075346d8e496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3091ac6-fce6-4022-a487-075346d8e496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-121773810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50fe4436-ebed-4fe9-8b53-368cb4ef86ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b028e64314c04b4c9e91bce8353f2570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:16:32Z,use_quota=True,user_id='f524b50a50ba4120b490ab57be3f8b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a8ca338-fb5a-47dc-bbcf-231bcdc5c592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a8ca338-fb5a-47dc-bbcf-231bcdc5c592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd4a53f-dc70-49ee-b8f4-a60a5988948f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd4a53f-dc70-49ee-b8f4-a60a5988948f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50fe4436-ebed-4fe9-8b53-368cb4ef86ab', 'volume_name': 'volume-50fe4436-ebed-4fe9-8b53-368cb4ef86ab', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0a9d5f-5549-4284-a684-87a5f1f4e97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0a9d5f-5549-4284-a684-87a5f1f4e97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a2bec7-c15d-4965-8f7e-582123b29759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:32 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Volume 50fe4436-ebed-4fe9-8b53-368cb4ef86ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50fe4436-ebed-4fe9-8b53-368cb4ef86ab', 'volume_size': 1} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Flow 'volume_create_manager' (7e6752ac-b1d3-4ce3-b61c-91d5d95b78ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54377354-f16e-4a07-9fbb-3c5b237c6e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54377354-f16e-4a07-9fbb-3c5b237c6e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1165775536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4f5fcd6-e60e-40ac-a595-3258496bf5b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e7bce18c8d74ae79a1742a4214522a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:16:32Z,use_quota=True,user_id='b1a465fe5fd64827a930ae52739aea90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f211c4-0182-4c4a-ac1e-66b944730117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f211c4-0182-4c4a-ac1e-66b944730117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3cbd61-683c-49f3-a761-c43ca6f1033f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3cbd61-683c-49f3-a761-c43ca6f1033f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4f5fcd6-e60e-40ac-a595-3258496bf5b5', 'volume_name': 'volume-f4f5fcd6-e60e-40ac-a595-3258496bf5b5', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a6f177e-224d-42c6-b9e2-9b0a9bd5d02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a6f177e-224d-42c6-b9e2-9b0a9bd5d02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce5848ff-fe3f-44f6-ba5d-6da02bf396e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:32 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Volume f4f5fcd6-e60e-40ac-a595-3258496bf5b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4f5fcd6-e60e-40ac-a595-3258496bf5b5', 'volume_size': 1} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Flow 'volume_create_manager' (e406b7d0-54f7-47a7-ab31-f1a82f2219a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37d40bc6-fc87-4b0e-839c-db5a6c4bbe57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37d40bc6-fc87-4b0e-839c-db5a6c4bbe57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1887892869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc88205-466d-437a-b23a-561b04a998a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e7bce18c8d74ae79a1742a4214522a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:16:32Z,use_quota=True,user_id='b1a465fe5fd64827a930ae52739aea90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (445cc184-4438-438d-862a-be919f841165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (445cc184-4438-438d-862a-be919f841165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49aa5624-0baa-4364-ba40-c1e48dbb7d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49aa5624-0baa-4364-ba40-c1e48dbb7d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afc88205-466d-437a-b23a-561b04a998a3', 'volume_name': 'volume-afc88205-466d-437a-b23a-561b04a998a3', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f424b94a-524e-4cf6-9c8b-52b2e98b711a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f424b94a-524e-4cf6-9c8b-52b2e98b711a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e543ce-ca78-477e-9689-27ac39fa013a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:32 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Volume afc88205-466d-437a-b23a-561b04a998a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afc88205-466d-437a-b23a-561b04a998a3', 'volume_size': 1} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:32 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-496e0c4f-1532-4752-b2f1-5f9f6185794b" returned: 0 in 1.239s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] <== create_volume: return (2804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.810s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.295s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1754525941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4e0bc7-0cad-4d41-baf6-14a97847427e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e7bce18c8d74ae79a1742a4214522a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:16:30Z,use_quota=True,user_id='b1a465fe5fd64827a930ae52739aea90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Creating volume 9b4e0bc7-0cad-4d41-baf6-14a97847427e {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:16:32 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9b4e0bc7-0cad-4d41-baf6-14a97847427e 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:32 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9b4e0bc7-0cad-4d41-baf6-14a97847427e 1073741824 Jun 30 16:16:32 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a52c20-96f2-4967-aa5c-d4b92e678d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-496e0c4f-1532-4752-b2f1-5f9f6185794b', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276f07a1-5ea7-4396-b646-ba99ef8895f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:32 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Volume volume-496e0c4f-1532-4752-b2f1-5f9f6185794b (496e0c4f-1532-4752-b2f1-5f9f6185794b): created successfully Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276f07a1-5ea7-4396-b646-ba99ef8895f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Flow 'volume_create_manager' (230ad19c-19f2-4c6e-b466-af72b002900e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:16:32 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-d8c31bb7-c6e7-44a3-a341-034da6a4f90a tempest-CreateVolumesFromImageTest-434612063 None] Created volume successfully. Jun 30 16:16:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:16:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:16:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:16:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:33 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:16:33 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:33 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9b4e0bc7-0cad-4d41-baf6-14a97847427e 1073741824" returned: 0 in 1.005s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9b4e0bc7-0cad-4d41-baf6-14a97847427e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:33 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9b4e0bc7-0cad-4d41-baf6-14a97847427e Jun 30 16:16:33 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:33 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.895s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:33 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:16:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:16:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 28 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:16:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:16:34 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9b4e0bc7-0cad-4d41-baf6-14a97847427e" returned: 0 in 0.733s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:16:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.285s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-851589619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=867da2a3-a529-4852-a9e9-86b080e74027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e7bce18c8d74ae79a1742a4214522a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:16:32Z,use_quota=True,user_id='b1a465fe5fd64827a930ae52739aea90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:16:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Creating volume 867da2a3-a529-4852-a9e9-86b080e74027 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:16:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:16:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:16:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:16:34 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:16:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-867da2a3-a529-4852-a9e9-86b080e74027 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:34 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-867da2a3-a529-4852-a9e9-86b080e74027 1073741824 Jun 30 16:16:34 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3effa609-9877-4338-a58f-465d277f16b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b4e0bc7-0cad-4d41-baf6-14a97847427e', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e64f46-1b2c-41ec-8e88-fed82caf8b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:34 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Volume volume-9b4e0bc7-0cad-4d41-baf6-14a97847427e (9b4e0bc7-0cad-4d41-baf6-14a97847427e): created successfully Jun 30 16:16:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e64f46-1b2c-41ec-8e88-fed82caf8b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Flow 'volume_create_manager' (0b0d604b-44f9-42b3-b771-c426ff997bcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:16:34 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-be657ae1-c7e4-46dc-baec-12d66a8fb801 tempest-CreateVolumesFromImageTest-434612063 None] Created volume successfully. Jun 30 16:16:35 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-867da2a3-a529-4852-a9e9-86b080e74027 1073741824" returned: 0 in 0.975s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-867da2a3-a529-4852-a9e9-86b080e74027 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:35 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-867da2a3-a529-4852-a9e9-86b080e74027 Jun 30 16:16:35 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:36 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-867da2a3-a529-4852-a9e9-86b080e74027" returned: 0 in 0.735s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:16:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.907s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-121773810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50fe4436-ebed-4fe9-8b53-368cb4ef86ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b028e64314c04b4c9e91bce8353f2570',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:16:32Z,use_quota=True,user_id='f524b50a50ba4120b490ab57be3f8b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:16:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Creating volume 50fe4436-ebed-4fe9-8b53-368cb4ef86ab {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:16:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:16:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:16:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:16:36 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:16:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-50fe4436-ebed-4fe9-8b53-368cb4ef86ab 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbbd223-7855-4487-adbd-6217fbe1c0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-867da2a3-a529-4852-a9e9-86b080e74027', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ddb218-2e1c-4af9-aa71-a59edc71d610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:36 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-50fe4436-ebed-4fe9-8b53-368cb4ef86ab 1073741824 Jun 30 16:16:36 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:36 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Volume volume-867da2a3-a529-4852-a9e9-86b080e74027 (867da2a3-a529-4852-a9e9-86b080e74027): created successfully Jun 30 16:16:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ddb218-2e1c-4af9-aa71-a59edc71d610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Flow 'volume_create_manager' (09abbf9e-49c3-40e5-884f-39393994d461) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:16:36 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-c2457af9-3ac6-48e4-89c1-dc079ff1f9a2 tempest-CreateVolumesFromImageTest-434612063 None] Created volume successfully. Jun 30 16:16:37 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-50fe4436-ebed-4fe9-8b53-368cb4ef86ab 1073741824" returned: 0 in 1.015s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-50fe4436-ebed-4fe9-8b53-368cb4ef86ab {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:37 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-50fe4436-ebed-4fe9-8b53-368cb4ef86ab Jun 30 16:16:37 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:38 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-50fe4436-ebed-4fe9-8b53-368cb4ef86ab" returned: 0 in 0.738s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:16:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.640s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1165775536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4f5fcd6-e60e-40ac-a595-3258496bf5b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e7bce18c8d74ae79a1742a4214522a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:16:32Z,use_quota=True,user_id='b1a465fe5fd64827a930ae52739aea90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:16:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Creating volume f4f5fcd6-e60e-40ac-a595-3258496bf5b5 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:16:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:16:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:16:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:16:38 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:16:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f4f5fcd6-e60e-40ac-a595-3258496bf5b5 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a2bec7-c15d-4965-8f7e-582123b29759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50fe4436-ebed-4fe9-8b53-368cb4ef86ab', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:38 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f4f5fcd6-e60e-40ac-a595-3258496bf5b5 1073741824 Jun 30 16:16:38 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81789db-eff2-463f-bf3b-7f443d00062e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:38 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Volume volume-50fe4436-ebed-4fe9-8b53-368cb4ef86ab (50fe4436-ebed-4fe9-8b53-368cb4ef86ab): created successfully Jun 30 16:16:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81789db-eff2-463f-bf3b-7f443d00062e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Flow 'volume_create_manager' (5300cb40-b6d5-42ba-9b02-440da1df1f05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:16:38 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-6550516d-caaf-44e6-90e1-533ac8be1540 tempest-AttachVolumeNegativeTest-2129882576 None] Created volume successfully. Jun 30 16:16:39 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f4f5fcd6-e60e-40ac-a595-3258496bf5b5 1073741824" returned: 0 in 1.132s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f4f5fcd6-e60e-40ac-a595-3258496bf5b5 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:39 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f4f5fcd6-e60e-40ac-a595-3258496bf5b5 Jun 30 16:16:39 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:40 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f4f5fcd6-e60e-40ac-a595-3258496bf5b5" returned: 0 in 0.746s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:16:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.437s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1887892869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc88205-466d-437a-b23a-561b04a998a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e7bce18c8d74ae79a1742a4214522a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:16:32Z,use_quota=True,user_id='b1a465fe5fd64827a930ae52739aea90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:16:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Creating volume afc88205-466d-437a-b23a-561b04a998a3 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:16:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:16:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:16:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:16:40 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:16:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-afc88205-466d-437a-b23a-561b04a998a3 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:40 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-afc88205-466d-437a-b23a-561b04a998a3 1073741824 Jun 30 16:16:40 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce5848ff-fe3f-44f6-ba5d-6da02bf396e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4f5fcd6-e60e-40ac-a595-3258496bf5b5', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58b5f50-d230-4673-9331-26afdec50a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:40 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Volume volume-f4f5fcd6-e60e-40ac-a595-3258496bf5b5 (f4f5fcd6-e60e-40ac-a595-3258496bf5b5): created successfully Jun 30 16:16:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58b5f50-d230-4673-9331-26afdec50a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Flow 'volume_create_manager' (7e6752ac-b1d3-4ce3-b61c-91d5d95b78ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:16:40 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-f79a628f-e60d-4722-8e6e-1fd795db678c tempest-CreateVolumesFromImageTest-434612063 None] Created volume successfully. Jun 30 16:16:41 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-afc88205-466d-437a-b23a-561b04a998a3 1073741824" returned: 0 in 1.060s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-afc88205-466d-437a-b23a-561b04a998a3 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:41 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-afc88205-466d-437a-b23a-561b04a998a3 Jun 30 16:16:41 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-a7d780d0-7339-440c-a11b-52cc742799dc req-15e6e955-9069-4243-8116-675c7068a490 tempest-AttachVolumeNegativeTest-2129882576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:41 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-afc88205-466d-437a-b23a-561b04a998a3" returned: 0 in 0.723s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:16:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-a7d780d0-7339-440c-a11b-52cc742799dc req-15e6e955-9069-4243-8116-675c7068a490 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.049s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:41 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e543ce-ca78-477e-9689-27ac39fa013a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afc88205-466d-437a-b23a-561b04a998a3', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:41 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f161b5-0b33-4f1b-b9d3-3283fe0a9387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:41 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[73586cdd-eaa0-467a-99f8-4cbc77ffd236]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:16:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-a7d780d0-7339-440c-a11b-52cc742799dc req-15e6e955-9069-4243-8116-675c7068a490 tempest-AttachVolumeNegativeTest-2129882576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-50fe4436-ebed-4fe9-8b53-368cb4ef86ab {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:41 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Volume volume-afc88205-466d-437a-b23a-561b04a998a3 (afc88205-466d-437a-b23a-561b04a998a3): created successfully Jun 30 16:16:41 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f161b5-0b33-4f1b-b9d3-3283fe0a9387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:41 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Flow 'volume_create_manager' (e406b7d0-54f7-47a7-ab31-f1a82f2219a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:16:41 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-5308e80d-3590-47c9-a386-57584718f947 tempest-CreateVolumesFromImageTest-434612063 None] Created volume successfully. Jun 30 16:16:42 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-50fe4436-ebed-4fe9-8b53-368cb4ef86ab Jun 30 16:16:42 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:42 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c2fbfd14-d39c-4512-b257-3b51605b95fa tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "cinder-afc88205-466d-437a-b23a-561b04a998a3-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:16:42 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c2fbfd14-d39c-4512-b257-3b51605b95fa tempest-CreateVolumesFromImageTest-434612063 None] Lock "cinder-afc88205-466d-437a-b23a-561b04a998a3-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:16:42 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c2fbfd14-d39c-4512-b257-3b51605b95fa tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "cinder-quobyte-afc88205-466d-437a-b23a-561b04a998a3" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:16:42 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c2fbfd14-d39c-4512-b257-3b51605b95fa tempest-CreateVolumesFromImageTest-434612063 None] Lock "cinder-quobyte-afc88205-466d-437a-b23a-561b04a998a3" acquired by "delete_volume" :: waited 0.019s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:16:42 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1c8fc6-dfe6-449a-919c-63cc9809a5bd]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:16:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c2fbfd14-d39c-4512-b257-3b51605b95fa tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-afc88205-466d-437a-b23a-561b04a998a3 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:42 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-a7d780d0-7339-440c-a11b-52cc742799dc req-15e6e955-9069-4243-8116-675c7068a490 tempest-AttachVolumeNegativeTest-2129882576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-50fe4436-ebed-4fe9-8b53-368cb4ef86ab" returned: 0 in 1.020s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-a7d780d0-7339-440c-a11b-52cc742799dc req-15e6e955-9069-4243-8116-675c7068a490 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.055s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:42 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-a7d780d0-7339-440c-a11b-52cc742799dc req-15e6e955-9069-4243-8116-675c7068a490 tempest-AttachVolumeNegativeTest-2129882576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a', 'name': 'volume-50fe4436-ebed-4fe9-8b53-368cb4ef86ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f3fabcb-3b33-4be4-8452-01ebe2497349', 'enforce_multipath': True} {{(pid=93781) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 30 16:16:42 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-afc88205-466d-437a-b23a-561b04a998a3 Jun 30 16:16:42 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:43 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-a7d780d0-7339-440c-a11b-52cc742799dc req-15e6e955-9069-4243-8116-675c7068a490 tempest-AttachVolumeNegativeTest-2129882576 None] attachment_update completed successfully. Jun 30 16:16:43 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c2fbfd14-d39c-4512-b257-3b51605b95fa tempest-CreateVolumesFromImageTest-434612063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-afc88205-466d-437a-b23a-561b04a998a3" returned: 0 in 1.134s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c2fbfd14-d39c-4512-b257-3b51605b95fa tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-afc88205-466d-437a-b23a-561b04a998a3 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:43 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-afc88205-466d-437a-b23a-561b04a998a3 Jun 30 16:16:43 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:45 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c2fbfd14-d39c-4512-b257-3b51605b95fa tempest-CreateVolumesFromImageTest-434612063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-afc88205-466d-437a-b23a-561b04a998a3" returned: 0 in 1.237s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c2fbfd14-d39c-4512-b257-3b51605b95fa tempest-CreateVolumesFromImageTest-434612063 None] Lock "cinder-quobyte-afc88205-466d-437a-b23a-561b04a998a3" released by "delete_volume" :: held 2.451s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:16:45 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-c2fbfd14-d39c-4512-b257-3b51605b95fa tempest-CreateVolumesFromImageTest-434612063 None] Created reservations ['8e49047b-36e3-44f4-9580-49dc24628e29', '96616a5a-df24-4079-93fb-b9491dd053be', '01d46d3c-8844-44cc-ad45-3d1cfe98e32a', '475a4b03-8cc2-4db1-b7b4-52fba0e79ab9'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:16:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c2fbfd14-d39c-4512-b257-3b51605b95fa tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c2fbfd14-d39c-4512-b257-3b51605b95fa tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:45 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c2fbfd14-d39c-4512-b257-3b51605b95fa tempest-CreateVolumesFromImageTest-434612063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:16:45 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c2fbfd14-d39c-4512-b257-3b51605b95fa tempest-CreateVolumesFromImageTest-434612063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:16:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c2fbfd14-d39c-4512-b257-3b51605b95fa tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c2fbfd14-d39c-4512-b257-3b51605b95fa tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:45 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:16:45 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:46 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ef6ab105-2fbd-4244-9489-b6e99cefc709 tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "cinder-f4f5fcd6-e60e-40ac-a595-3258496bf5b5-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:16:46 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ef6ab105-2fbd-4244-9489-b6e99cefc709 tempest-CreateVolumesFromImageTest-434612063 None] Lock "cinder-f4f5fcd6-e60e-40ac-a595-3258496bf5b5-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:16:46 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ef6ab105-2fbd-4244-9489-b6e99cefc709 tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "cinder-quobyte-f4f5fcd6-e60e-40ac-a595-3258496bf5b5" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:16:46 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ef6ab105-2fbd-4244-9489-b6e99cefc709 tempest-CreateVolumesFromImageTest-434612063 None] Lock "cinder-quobyte-f4f5fcd6-e60e-40ac-a595-3258496bf5b5" acquired by "delete_volume" :: waited 0.033s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:16:46 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c34c1e-beac-48f3-b0a9-43e67ff73271]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:16:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ef6ab105-2fbd-4244-9489-b6e99cefc709 tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f4f5fcd6-e60e-40ac-a595-3258496bf5b5 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:46 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c2fbfd14-d39c-4512-b257-3b51605b95fa tempest-CreateVolumesFromImageTest-434612063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.960s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:46 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-c2fbfd14-d39c-4512-b257-3b51605b95fa tempest-CreateVolumesFromImageTest-434612063 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:16:46 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-c2fbfd14-d39c-4512-b257-3b51605b95fa tempest-CreateVolumesFromImageTest-434612063 None] Deleted volume successfully. Jun 30 16:16:46 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f4f5fcd6-e60e-40ac-a595-3258496bf5b5 Jun 30 16:16:46 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:46 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c2fbfd14-d39c-4512-b257-3b51605b95fa tempest-CreateVolumesFromImageTest-434612063 None] Lock "cinder-afc88205-466d-437a-b23a-561b04a998a3-delete_volume" released by "delete_volume" :: held 3.769s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:16:47 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ef6ab105-2fbd-4244-9489-b6e99cefc709 tempest-CreateVolumesFromImageTest-434612063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f4f5fcd6-e60e-40ac-a595-3258496bf5b5" returned: 0 in 0.874s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ef6ab105-2fbd-4244-9489-b6e99cefc709 tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f4f5fcd6-e60e-40ac-a595-3258496bf5b5 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:47 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f4f5fcd6-e60e-40ac-a595-3258496bf5b5 Jun 30 16:16:47 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:47 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ef6ab105-2fbd-4244-9489-b6e99cefc709 tempest-CreateVolumesFromImageTest-434612063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f4f5fcd6-e60e-40ac-a595-3258496bf5b5" returned: 0 in 0.740s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:47 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ef6ab105-2fbd-4244-9489-b6e99cefc709 tempest-CreateVolumesFromImageTest-434612063 None] Lock "cinder-quobyte-f4f5fcd6-e60e-40ac-a595-3258496bf5b5" released by "delete_volume" :: held 1.682s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:16:47 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-ef6ab105-2fbd-4244-9489-b6e99cefc709 tempest-CreateVolumesFromImageTest-434612063 None] Created reservations ['e6f550f7-d9da-4404-884a-0746d7aa8c51', '2641f1d8-4ba7-4d1c-a87c-f33a40ec0910', 'e2c0da14-08e3-49a0-8129-634f28835f03', '28c287ab-ea0b-4c25-82e4-62190b1657b8'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:16:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ef6ab105-2fbd-4244-9489-b6e99cefc709 tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ef6ab105-2fbd-4244-9489-b6e99cefc709 tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:48 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ef6ab105-2fbd-4244-9489-b6e99cefc709 tempest-CreateVolumesFromImageTest-434612063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:16:48 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ef6ab105-2fbd-4244-9489-b6e99cefc709 tempest-CreateVolumesFromImageTest-434612063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:16:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ef6ab105-2fbd-4244-9489-b6e99cefc709 tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ef6ab105-2fbd-4244-9489-b6e99cefc709 tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:48 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:16:48 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-35dc7577-c723-494a-9959-c002f82df820 tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "cinder-867da2a3-a529-4852-a9e9-86b080e74027-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:16:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-35dc7577-c723-494a-9959-c002f82df820 tempest-CreateVolumesFromImageTest-434612063 None] Lock "cinder-867da2a3-a529-4852-a9e9-86b080e74027-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:16:48 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:UPDATE=74,cinder:SELECT=61,cinder:INSERT=23,cinder:DELETE=9 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:16:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-35dc7577-c723-494a-9959-c002f82df820 tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "cinder-quobyte-867da2a3-a529-4852-a9e9-86b080e74027" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:16:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-35dc7577-c723-494a-9959-c002f82df820 tempest-CreateVolumesFromImageTest-434612063 None] Lock "cinder-quobyte-867da2a3-a529-4852-a9e9-86b080e74027" acquired by "delete_volume" :: waited 0.020s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:16:48 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[d881305b-5ecd-4944-9baa-ba373a7c3316]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:16:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-35dc7577-c723-494a-9959-c002f82df820 tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-867da2a3-a529-4852-a9e9-86b080e74027 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:48 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-867da2a3-a529-4852-a9e9-86b080e74027 Jun 30 16:16:48 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:49 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ef6ab105-2fbd-4244-9489-b6e99cefc709 tempest-CreateVolumesFromImageTest-434612063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.034s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:49 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-ef6ab105-2fbd-4244-9489-b6e99cefc709 tempest-CreateVolumesFromImageTest-434612063 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:16:49 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-ef6ab105-2fbd-4244-9489-b6e99cefc709 tempest-CreateVolumesFromImageTest-434612063 None] Deleted volume successfully. Jun 30 16:16:49 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ef6ab105-2fbd-4244-9489-b6e99cefc709 tempest-CreateVolumesFromImageTest-434612063 None] Lock "cinder-f4f5fcd6-e60e-40ac-a595-3258496bf5b5-delete_volume" released by "delete_volume" :: held 3.025s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:16:49 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-35dc7577-c723-494a-9959-c002f82df820 tempest-CreateVolumesFromImageTest-434612063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-867da2a3-a529-4852-a9e9-86b080e74027" returned: 0 in 0.964s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-35dc7577-c723-494a-9959-c002f82df820 tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-867da2a3-a529-4852-a9e9-86b080e74027 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:49 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-867da2a3-a529-4852-a9e9-86b080e74027 Jun 30 16:16:49 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:50 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-35dc7577-c723-494a-9959-c002f82df820 tempest-CreateVolumesFromImageTest-434612063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-867da2a3-a529-4852-a9e9-86b080e74027" returned: 0 in 0.764s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-35dc7577-c723-494a-9959-c002f82df820 tempest-CreateVolumesFromImageTest-434612063 None] Lock "cinder-quobyte-867da2a3-a529-4852-a9e9-86b080e74027" released by "delete_volume" :: held 1.815s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:16:50 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-35dc7577-c723-494a-9959-c002f82df820 tempest-CreateVolumesFromImageTest-434612063 None] Created reservations ['9fdc644d-10b2-441b-8724-d50d2f4ee830', 'f7ca003c-0ec9-4f2b-95da-9f2c7000eb75', '977a9f6e-f160-4e02-a80d-cd91ba391690', 'ca486e06-a62e-4119-bb5f-2365b220322c'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:16:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-35dc7577-c723-494a-9959-c002f82df820 tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-35dc7577-c723-494a-9959-c002f82df820 tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:50 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-35dc7577-c723-494a-9959-c002f82df820 tempest-CreateVolumesFromImageTest-434612063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:16:50 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-35dc7577-c723-494a-9959-c002f82df820 tempest-CreateVolumesFromImageTest-434612063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:16:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-35dc7577-c723-494a-9959-c002f82df820 tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-35dc7577-c723-494a-9959-c002f82df820 tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:50 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:16:50 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:50 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-70f6574e-96ae-4975-be94-f4ec4b19e949 req-aa297828-1ecc-489c-baa4-3dbf7b0e529c tempest-AttachVolumeNegativeTest-2129882576 None] Terminate volume connection completed successfully. Jun 30 16:16:50 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-70f6574e-96ae-4975-be94-f4ec4b19e949 req-aa297828-1ecc-489c-baa4-3dbf7b0e529c tempest-AttachVolumeNegativeTest-2129882576 None] Deleting attachment 9f3fabcb-3b33-4be4-8452-01ebe2497349. {{(pid=93781) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 30 16:16:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a53241af-c768-4bc3-8cd5-5aa7297b86fb tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "cinder-9b4e0bc7-0cad-4d41-baf6-14a97847427e-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:16:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a53241af-c768-4bc3-8cd5-5aa7297b86fb tempest-CreateVolumesFromImageTest-434612063 None] Lock "cinder-9b4e0bc7-0cad-4d41-baf6-14a97847427e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:16:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a53241af-c768-4bc3-8cd5-5aa7297b86fb tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "cinder-quobyte-9b4e0bc7-0cad-4d41-baf6-14a97847427e" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:16:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a53241af-c768-4bc3-8cd5-5aa7297b86fb tempest-CreateVolumesFromImageTest-434612063 None] Lock "cinder-quobyte-9b4e0bc7-0cad-4d41-baf6-14a97847427e" acquired by "delete_volume" :: waited 0.019s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:16:50 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0368954-9dd5-4be8-8732-e26745bace52]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:16:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a53241af-c768-4bc3-8cd5-5aa7297b86fb tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9b4e0bc7-0cad-4d41-baf6-14a97847427e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:50 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9b4e0bc7-0cad-4d41-baf6-14a97847427e Jun 30 16:16:50 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:51 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-35dc7577-c723-494a-9959-c002f82df820 tempest-CreateVolumesFromImageTest-434612063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.748s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:51 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-35dc7577-c723-494a-9959-c002f82df820 tempest-CreateVolumesFromImageTest-434612063 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:16:51 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-35dc7577-c723-494a-9959-c002f82df820 tempest-CreateVolumesFromImageTest-434612063 None] Deleted volume successfully. Jun 30 16:16:51 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-35dc7577-c723-494a-9959-c002f82df820 tempest-CreateVolumesFromImageTest-434612063 None] Lock "cinder-867da2a3-a529-4852-a9e9-86b080e74027-delete_volume" released by "delete_volume" :: held 2.813s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:16:51 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a53241af-c768-4bc3-8cd5-5aa7297b86fb tempest-CreateVolumesFromImageTest-434612063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9b4e0bc7-0cad-4d41-baf6-14a97847427e" returned: 0 in 0.932s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a53241af-c768-4bc3-8cd5-5aa7297b86fb tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9b4e0bc7-0cad-4d41-baf6-14a97847427e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:51 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9b4e0bc7-0cad-4d41-baf6-14a97847427e Jun 30 16:16:51 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:52 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a53241af-c768-4bc3-8cd5-5aa7297b86fb tempest-CreateVolumesFromImageTest-434612063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9b4e0bc7-0cad-4d41-baf6-14a97847427e" returned: 0 in 1.147s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:52 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a53241af-c768-4bc3-8cd5-5aa7297b86fb tempest-CreateVolumesFromImageTest-434612063 None] Lock "cinder-quobyte-9b4e0bc7-0cad-4d41-baf6-14a97847427e" released by "delete_volume" :: held 2.184s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:16:53 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-a53241af-c768-4bc3-8cd5-5aa7297b86fb tempest-CreateVolumesFromImageTest-434612063 None] Created reservations ['dfb01a5e-f9f4-48d9-a81a-5dce67bef5cc', 'af85f8da-446b-4ce6-baff-b012643d2620', '1d8a5b53-2f7c-408f-9722-3ed96405da74', '8f05f875-d559-4b39-aee5-058f5c631e23'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:16:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a53241af-c768-4bc3-8cd5-5aa7297b86fb tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a53241af-c768-4bc3-8cd5-5aa7297b86fb tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a53241af-c768-4bc3-8cd5-5aa7297b86fb tempest-CreateVolumesFromImageTest-434612063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:16:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a53241af-c768-4bc3-8cd5-5aa7297b86fb tempest-CreateVolumesFromImageTest-434612063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:16:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a53241af-c768-4bc3-8cd5-5aa7297b86fb tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a53241af-c768-4bc3-8cd5-5aa7297b86fb tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:53 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:16:53 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:54 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a88c88bd-4549-4e5d-a8ee-101990841c5a tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "cinder-496e0c4f-1532-4752-b2f1-5f9f6185794b-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:16:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a53241af-c768-4bc3-8cd5-5aa7297b86fb tempest-CreateVolumesFromImageTest-434612063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.952s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:54 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a53241af-c768-4bc3-8cd5-5aa7297b86fb tempest-CreateVolumesFromImageTest-434612063 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:16:54 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-a53241af-c768-4bc3-8cd5-5aa7297b86fb tempest-CreateVolumesFromImageTest-434612063 None] Deleted volume successfully. Jun 30 16:16:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a88c88bd-4549-4e5d-a8ee-101990841c5a tempest-CreateVolumesFromImageTest-434612063 None] Lock "cinder-496e0c4f-1532-4752-b2f1-5f9f6185794b-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:16:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a53241af-c768-4bc3-8cd5-5aa7297b86fb tempest-CreateVolumesFromImageTest-434612063 None] Lock "cinder-9b4e0bc7-0cad-4d41-baf6-14a97847427e-delete_volume" released by "delete_volume" :: held 3.739s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:16:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a88c88bd-4549-4e5d-a8ee-101990841c5a tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "cinder-quobyte-496e0c4f-1532-4752-b2f1-5f9f6185794b" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:16:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a88c88bd-4549-4e5d-a8ee-101990841c5a tempest-CreateVolumesFromImageTest-434612063 None] Lock "cinder-quobyte-496e0c4f-1532-4752-b2f1-5f9f6185794b" acquired by "delete_volume" :: waited 0.038s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:16:54 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9678386-9ea1-407d-b2b3-d32f60d3f3c3]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:16:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a88c88bd-4549-4e5d-a8ee-101990841c5a tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-496e0c4f-1532-4752-b2f1-5f9f6185794b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:54 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-496e0c4f-1532-4752-b2f1-5f9f6185794b Jun 30 16:16:54 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:56 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a88c88bd-4549-4e5d-a8ee-101990841c5a tempest-CreateVolumesFromImageTest-434612063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-496e0c4f-1532-4752-b2f1-5f9f6185794b" returned: 0 in 1.573s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a88c88bd-4549-4e5d-a8ee-101990841c5a tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-496e0c4f-1532-4752-b2f1-5f9f6185794b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:56 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-496e0c4f-1532-4752-b2f1-5f9f6185794b Jun 30 16:16:56 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:57 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a88c88bd-4549-4e5d-a8ee-101990841c5a tempest-CreateVolumesFromImageTest-434612063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-496e0c4f-1532-4752-b2f1-5f9f6185794b" returned: 0 in 1.213s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a88c88bd-4549-4e5d-a8ee-101990841c5a tempest-CreateVolumesFromImageTest-434612063 None] Lock "cinder-quobyte-496e0c4f-1532-4752-b2f1-5f9f6185794b" released by "delete_volume" :: held 2.854s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-a88c88bd-4549-4e5d-a8ee-101990841c5a tempest-CreateVolumesFromImageTest-434612063 None] Created reservations ['07939d51-5a79-414a-8d98-d30c8e3ab097', '353995cf-ee98-45d6-8439-957133202929', '5827cf17-cb91-4988-b2f2-e95816e61bb4', '1ef30346-05e6-4181-af0d-c51aca6be1d4'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a88c88bd-4549-4e5d-a8ee-101990841c5a tempest-CreateVolumesFromImageTest-434612063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a88c88bd-4549-4e5d-a8ee-101990841c5a tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a88c88bd-4549-4e5d-a8ee-101990841c5a tempest-CreateVolumesFromImageTest-434612063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a88c88bd-4549-4e5d-a8ee-101990841c5a tempest-CreateVolumesFromImageTest-434612063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a88c88bd-4549-4e5d-a8ee-101990841c5a tempest-CreateVolumesFromImageTest-434612063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a88c88bd-4549-4e5d-a8ee-101990841c5a tempest-CreateVolumesFromImageTest-434612063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:57 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:16:57 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Flow 'volume_create_manager' (4f930c45-cf8e-4543-ab08-f09ef0479a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff49eb1c-0849-4e7d-931d-29676d9410cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff49eb1c-0849-4e7d-931d-29676d9410cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-793349700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd0ce268-c94d-46d1-96ca-32ce8931f716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528a5e7dceb143169d0bad617fa01e10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:16:58Z,use_quota=True,user_id='530f09ec6fb1475fba1c05b072c60f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ffbb37c-1465-41b3-af21-2f46a782e871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ffbb37c-1465-41b3-af21-2f46a782e871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e05334-1fc1-43df-b683-d3b2a4b62833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e05334-1fc1-43df-b683-d3b2a4b62833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd0ce268-c94d-46d1-96ca-32ce8931f716', 'volume_name': 'volume-dd0ce268-c94d-46d1-96ca-32ce8931f716', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98fcfc25-87a4-49e7-9efa-1acb41a53737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98fcfc25-87a4-49e7-9efa-1acb41a53737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0268eaad-2461-4277-b794-e3f445d54357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:16:57 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Volume dd0ce268-c94d-46d1-96ca-32ce8931f716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd0ce268-c94d-46d1-96ca-32ce8931f716', 'volume_size': 1} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-793349700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd0ce268-c94d-46d1-96ca-32ce8931f716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528a5e7dceb143169d0bad617fa01e10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:16:58Z,use_quota=True,user_id='530f09ec6fb1475fba1c05b072c60f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Creating volume dd0ce268-c94d-46d1-96ca-32ce8931f716 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:16:57 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:16:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dd0ce268-c94d-46d1-96ca-32ce8931f716 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:58 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dd0ce268-c94d-46d1-96ca-32ce8931f716 1073741824 Jun 30 16:16:58 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:16:58 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a88c88bd-4549-4e5d-a8ee-101990841c5a tempest-CreateVolumesFromImageTest-434612063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.942s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:58 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a88c88bd-4549-4e5d-a8ee-101990841c5a tempest-CreateVolumesFromImageTest-434612063 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:16:58 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-a88c88bd-4549-4e5d-a8ee-101990841c5a tempest-CreateVolumesFromImageTest-434612063 None] Deleted volume successfully. Jun 30 16:16:58 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a88c88bd-4549-4e5d-a8ee-101990841c5a tempest-CreateVolumesFromImageTest-434612063 None] Lock "cinder-496e0c4f-1532-4752-b2f1-5f9f6185794b-delete_volume" released by "delete_volume" :: held 4.249s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:16:59 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jun 30 16:16:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dd0ce268-c94d-46d1-96ca-32ce8931f716 1073741824" returned: 0 in 1.293s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:16:59 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=72,cinder:INSERT=29,cinder:UPDATE=91,cinder:DELETE=6 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:16:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dd0ce268-c94d-46d1-96ca-32ce8931f716 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:16:59 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dd0ce268-c94d-46d1-96ca-32ce8931f716 Jun 30 16:16:59 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:00 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dd0ce268-c94d-46d1-96ca-32ce8931f716" returned: 0 in 0.939s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:00 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] <== create_volume: return (2319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:17:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.323s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:00 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0268eaad-2461-4277-b794-e3f445d54357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd0ce268-c94d-46d1-96ca-32ce8931f716', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:00 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea6264b-9b60-4e06-a035-6d0cc44d3a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:00 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Volume volume-dd0ce268-c94d-46d1-96ca-32ce8931f716 (dd0ce268-c94d-46d1-96ca-32ce8931f716): created successfully Jun 30 16:17:00 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea6264b-9b60-4e06-a035-6d0cc44d3a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:00 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Flow 'volume_create_manager' (4f930c45-cf8e-4543-ab08-f09ef0479a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:17:00 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-64e05ecb-3c8b-4a8d-b458-5f71f0796885 tempest-VolumesActionsTest-459556707 None] Created volume successfully. Jun 30 16:17:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2ad562f3-6fb2-4e3e-9386-e8a31184b710 tempest-VolumesActionsTest-459556707 None] Acquiring lock "cinder-dd0ce268-c94d-46d1-96ca-32ce8931f716" by "attach_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2ad562f3-6fb2-4e3e-9386-e8a31184b710 tempest-VolumesActionsTest-459556707 None] Lock "cinder-dd0ce268-c94d-46d1-96ca-32ce8931f716" acquired by "attach_volume" :: waited 0.017s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:01 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-2ad562f3-6fb2-4e3e-9386-e8a31184b710 tempest-VolumesActionsTest-459556707 None] Attaching volume dd0ce268-c94d-46d1-96ca-32ce8931f716 to instance 67042058-fb4b-440e-b6f5-7e7349f7d3d3 at mountpoint /dev/vdb on host None. Jun 30 16:17:01 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-2ad562f3-6fb2-4e3e-9386-e8a31184b710 tempest-VolumesActionsTest-459556707 None] Attach volume completed successfully. Jun 30 16:17:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2ad562f3-6fb2-4e3e-9386-e8a31184b710 tempest-VolumesActionsTest-459556707 None] Lock "cinder-dd0ce268-c94d-46d1-96ca-32ce8931f716" released by "attach_volume" :: held 0.118s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-53995651-a484-4d3a-a9ca-6a9d206d7851 tempest-AttachVolumeNegativeTest-2129882576 None] Acquiring lock "cinder-50fe4436-ebed-4fe9-8b53-368cb4ef86ab-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-53995651-a484-4d3a-a9ca-6a9d206d7851 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "cinder-50fe4436-ebed-4fe9-8b53-368cb4ef86ab-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-53995651-a484-4d3a-a9ca-6a9d206d7851 tempest-AttachVolumeNegativeTest-2129882576 None] Acquiring lock "cinder-quobyte-50fe4436-ebed-4fe9-8b53-368cb4ef86ab" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-53995651-a484-4d3a-a9ca-6a9d206d7851 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "cinder-quobyte-50fe4436-ebed-4fe9-8b53-368cb4ef86ab" acquired by "delete_volume" :: waited 0.031s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:01 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[db53c42c-700d-4bd0-a493-55634dc15097]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:17:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-53995651-a484-4d3a-a9ca-6a9d206d7851 tempest-AttachVolumeNegativeTest-2129882576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-50fe4436-ebed-4fe9-8b53-368cb4ef86ab {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:02 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-50fe4436-ebed-4fe9-8b53-368cb4ef86ab Jun 30 16:17:02 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:02 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-4d1d19ac-6e2e-45ff-8f8c-a11aa28302d8 tempest-VolumesActionsTest-1656490605 None] Terminate volume connection completed successfully. Jun 30 16:17:02 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-53995651-a484-4d3a-a9ca-6a9d206d7851 tempest-AttachVolumeNegativeTest-2129882576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-50fe4436-ebed-4fe9-8b53-368cb4ef86ab" returned: 0 in 0.914s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-53995651-a484-4d3a-a9ca-6a9d206d7851 tempest-AttachVolumeNegativeTest-2129882576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-50fe4436-ebed-4fe9-8b53-368cb4ef86ab {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:02 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-50fe4436-ebed-4fe9-8b53-368cb4ef86ab Jun 30 16:17:02 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:02 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4d1d19ac-6e2e-45ff-8f8c-a11aa28302d8 tempest-VolumesActionsTest-1656490605 None] Acquiring lock "cinder-dd0ce268-c94d-46d1-96ca-32ce8931f716-detach_volume" by "detach_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:03 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4d1d19ac-6e2e-45ff-8f8c-a11aa28302d8 tempest-VolumesActionsTest-1656490605 None] Lock "cinder-dd0ce268-c94d-46d1-96ca-32ce8931f716-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:03 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-4d1d19ac-6e2e-45ff-8f8c-a11aa28302d8 tempest-VolumesActionsTest-1656490605 None] Detaching volume dd0ce268-c94d-46d1-96ca-32ce8931f716 from instance 67042058-fb4b-440e-b6f5-7e7349f7d3d3. Jun 30 16:17:03 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-4d1d19ac-6e2e-45ff-8f8c-a11aa28302d8 tempest-VolumesActionsTest-1656490605 None] Detach volume completed successfully. Jun 30 16:17:03 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4d1d19ac-6e2e-45ff-8f8c-a11aa28302d8 tempest-VolumesActionsTest-1656490605 None] Lock "cinder-dd0ce268-c94d-46d1-96ca-32ce8931f716-detach_volume" released by "detach_volume" :: held 0.085s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:03 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b3f25c29-2283-4f4e-9e84-20e379f1fc14 tempest-VolumesActionsTest-459556707 None] Acquiring lock "cinder-dd0ce268-c94d-46d1-96ca-32ce8931f716-detach_volume" by "detach_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:03 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b3f25c29-2283-4f4e-9e84-20e379f1fc14 tempest-VolumesActionsTest-459556707 None] Lock "cinder-dd0ce268-c94d-46d1-96ca-32ce8931f716-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:03 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-b3f25c29-2283-4f4e-9e84-20e379f1fc14 tempest-VolumesActionsTest-459556707 None] Volume detach called, but volume not attached. Jun 30 16:17:03 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b3f25c29-2283-4f4e-9e84-20e379f1fc14 tempest-VolumesActionsTest-459556707 None] Lock "cinder-dd0ce268-c94d-46d1-96ca-32ce8931f716-detach_volume" released by "detach_volume" :: held 0.023s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:03 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-53995651-a484-4d3a-a9ca-6a9d206d7851 tempest-AttachVolumeNegativeTest-2129882576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-50fe4436-ebed-4fe9-8b53-368cb4ef86ab" returned: 0 in 0.873s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:03 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-53995651-a484-4d3a-a9ca-6a9d206d7851 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "cinder-quobyte-50fe4436-ebed-4fe9-8b53-368cb4ef86ab" released by "delete_volume" :: held 1.879s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:03 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-53995651-a484-4d3a-a9ca-6a9d206d7851 tempest-AttachVolumeNegativeTest-2129882576 None] Created reservations ['6f9a236b-09ff-4d70-a1cc-d54fdd682a3e', '54c5084f-7a93-4ad6-b493-f7138236f562', '7c4ca1da-4257-42cf-8590-f22f65ba1e15', 'fd682504-3202-4005-a63f-793934e6c6a1'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:17:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-53995651-a484-4d3a-a9ca-6a9d206d7851 tempest-AttachVolumeNegativeTest-2129882576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-53995651-a484-4d3a-a9ca-6a9d206d7851 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-53995651-a484-4d3a-a9ca-6a9d206d7851 tempest-AttachVolumeNegativeTest-2129882576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:17:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-53995651-a484-4d3a-a9ca-6a9d206d7851 tempest-AttachVolumeNegativeTest-2129882576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:17:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-53995651-a484-4d3a-a9ca-6a9d206d7851 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-53995651-a484-4d3a-a9ca-6a9d206d7851 tempest-AttachVolumeNegativeTest-2129882576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:03 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:17:03 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8d81a904-ce6e-4d41-983a-b4013c3046b1 tempest-AttachVolumeNegativeTest-2129882576 None] Acquiring lock "cinder-ab86245d-71d0-4e59-b5fe-4ae8861543e5-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8d81a904-ce6e-4d41-983a-b4013c3046b1 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "cinder-ab86245d-71d0-4e59-b5fe-4ae8861543e5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8d81a904-ce6e-4d41-983a-b4013c3046b1 tempest-AttachVolumeNegativeTest-2129882576 None] Acquiring lock "cinder-quobyte-ab86245d-71d0-4e59-b5fe-4ae8861543e5" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8d81a904-ce6e-4d41-983a-b4013c3046b1 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "cinder-quobyte-ab86245d-71d0-4e59-b5fe-4ae8861543e5" acquired by "delete_volume" :: waited 0.026s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:04 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc50d7f-f8a0-4f49-9b21-ec8ed113103c]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:17:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8d81a904-ce6e-4d41-983a-b4013c3046b1 tempest-AttachVolumeNegativeTest-2129882576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ab86245d-71d0-4e59-b5fe-4ae8861543e5 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:04 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ab86245d-71d0-4e59-b5fe-4ae8861543e5 Jun 30 16:17:04 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3a6e2969-a8cd-42a2-a52b-b7533bfa2f8f tempest-VolumesActionsTest-459556707 None] Acquiring lock "cinder-dd0ce268-c94d-46d1-96ca-32ce8931f716-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3a6e2969-a8cd-42a2-a52b-b7533bfa2f8f tempest-VolumesActionsTest-459556707 None] Lock "cinder-dd0ce268-c94d-46d1-96ca-32ce8931f716-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3a6e2969-a8cd-42a2-a52b-b7533bfa2f8f tempest-VolumesActionsTest-459556707 None] Acquiring lock "cinder-quobyte-dd0ce268-c94d-46d1-96ca-32ce8931f716" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3a6e2969-a8cd-42a2-a52b-b7533bfa2f8f tempest-VolumesActionsTest-459556707 None] Lock "cinder-quobyte-dd0ce268-c94d-46d1-96ca-32ce8931f716" acquired by "delete_volume" :: waited 0.029s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:04 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4242eb-f81a-4f34-bfaf-9f68f14037c3]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:17:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3a6e2969-a8cd-42a2-a52b-b7533bfa2f8f tempest-VolumesActionsTest-459556707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dd0ce268-c94d-46d1-96ca-32ce8931f716 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:04 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dd0ce268-c94d-46d1-96ca-32ce8931f716 Jun 30 16:17:04 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:04 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-53995651-a484-4d3a-a9ca-6a9d206d7851 tempest-AttachVolumeNegativeTest-2129882576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.061s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:04 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-53995651-a484-4d3a-a9ca-6a9d206d7851 tempest-AttachVolumeNegativeTest-2129882576 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:17:04 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-53995651-a484-4d3a-a9ca-6a9d206d7851 tempest-AttachVolumeNegativeTest-2129882576 None] Deleted volume successfully. Jun 30 16:17:05 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-53995651-a484-4d3a-a9ca-6a9d206d7851 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "cinder-50fe4436-ebed-4fe9-8b53-368cb4ef86ab-delete_volume" released by "delete_volume" :: held 3.210s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:05 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8d81a904-ce6e-4d41-983a-b4013c3046b1 tempest-AttachVolumeNegativeTest-2129882576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ab86245d-71d0-4e59-b5fe-4ae8861543e5" returned: 0 in 1.023s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8d81a904-ce6e-4d41-983a-b4013c3046b1 tempest-AttachVolumeNegativeTest-2129882576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ab86245d-71d0-4e59-b5fe-4ae8861543e5 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:05 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ab86245d-71d0-4e59-b5fe-4ae8861543e5 Jun 30 16:17:05 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:05 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3a6e2969-a8cd-42a2-a52b-b7533bfa2f8f tempest-VolumesActionsTest-459556707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dd0ce268-c94d-46d1-96ca-32ce8931f716" returned: 0 in 0.944s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3a6e2969-a8cd-42a2-a52b-b7533bfa2f8f tempest-VolumesActionsTest-459556707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dd0ce268-c94d-46d1-96ca-32ce8931f716 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:05 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dd0ce268-c94d-46d1-96ca-32ce8931f716 Jun 30 16:17:05 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:06 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8d81a904-ce6e-4d41-983a-b4013c3046b1 tempest-AttachVolumeNegativeTest-2129882576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ab86245d-71d0-4e59-b5fe-4ae8861543e5" returned: 0 in 0.791s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8d81a904-ce6e-4d41-983a-b4013c3046b1 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "cinder-quobyte-ab86245d-71d0-4e59-b5fe-4ae8861543e5" released by "delete_volume" :: held 1.874s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-8d81a904-ce6e-4d41-983a-b4013c3046b1 tempest-AttachVolumeNegativeTest-2129882576 None] Created reservations ['eebf2170-dd2c-4e91-9921-358dedbae60e', '3beb2733-dd98-48ce-8280-a7c8e63eda31', '2cc9e687-ec8c-48b4-b359-c910762bf411', '909fb79d-907a-40aa-b2e4-79a34c5e5c63'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8d81a904-ce6e-4d41-983a-b4013c3046b1 tempest-AttachVolumeNegativeTest-2129882576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8d81a904-ce6e-4d41-983a-b4013c3046b1 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-8d81a904-ce6e-4d41-983a-b4013c3046b1 tempest-AttachVolumeNegativeTest-2129882576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-8d81a904-ce6e-4d41-983a-b4013c3046b1 tempest-AttachVolumeNegativeTest-2129882576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8d81a904-ce6e-4d41-983a-b4013c3046b1 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8d81a904-ce6e-4d41-983a-b4013c3046b1 tempest-AttachVolumeNegativeTest-2129882576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:06 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:17:06 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:06 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3a6e2969-a8cd-42a2-a52b-b7533bfa2f8f tempest-VolumesActionsTest-459556707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-dd0ce268-c94d-46d1-96ca-32ce8931f716" returned: 0 in 0.994s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3a6e2969-a8cd-42a2-a52b-b7533bfa2f8f tempest-VolumesActionsTest-459556707 None] Lock "cinder-quobyte-dd0ce268-c94d-46d1-96ca-32ce8931f716" released by "delete_volume" :: held 1.996s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7121ae8e-4dd0-4ceb-911d-e4c4e10716ac tempest-AttachVolumeNegativeTest-2129882576 None] Acquiring lock "cinder-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-3a6e2969-a8cd-42a2-a52b-b7533bfa2f8f tempest-VolumesActionsTest-459556707 None] Created reservations ['a98cf893-04e0-42ff-8bcf-a5cadf881911', 'f326336b-c5ee-43cc-9e95-cd93d2cff9ba', '1dd401c6-15ce-4cdb-bb80-8065891b73c2', 'ce464ea5-00ed-45b4-8f1a-4b9e3cf6294c'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7121ae8e-4dd0-4ceb-911d-e4c4e10716ac tempest-AttachVolumeNegativeTest-2129882576 None] Lock "cinder-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7121ae8e-4dd0-4ceb-911d-e4c4e10716ac tempest-AttachVolumeNegativeTest-2129882576 None] Acquiring lock "cinder-quobyte-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7121ae8e-4dd0-4ceb-911d-e4c4e10716ac tempest-AttachVolumeNegativeTest-2129882576 None] Lock "cinder-quobyte-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf" acquired by "delete_volume" :: waited 0.025s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3a6e2969-a8cd-42a2-a52b-b7533bfa2f8f tempest-VolumesActionsTest-459556707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3a6e2969-a8cd-42a2-a52b-b7533bfa2f8f tempest-VolumesActionsTest-459556707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e2969-a8cd-42a2-a52b-b7533bfa2f8f tempest-VolumesActionsTest-459556707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3a6e2969-a8cd-42a2-a52b-b7533bfa2f8f tempest-VolumesActionsTest-459556707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3a6e2969-a8cd-42a2-a52b-b7533bfa2f8f tempest-VolumesActionsTest-459556707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3a6e2969-a8cd-42a2-a52b-b7533bfa2f8f tempest-VolumesActionsTest-459556707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b549f0-ed97-4936-ae47-f22f1462f519]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:17:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7121ae8e-4dd0-4ceb-911d-e4c4e10716ac tempest-AttachVolumeNegativeTest-2129882576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:06 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:17:06 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:07 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf Jun 30 16:17:07 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:07 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8d81a904-ce6e-4d41-983a-b4013c3046b1 tempest-AttachVolumeNegativeTest-2129882576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.875s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:07 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-8d81a904-ce6e-4d41-983a-b4013c3046b1 tempest-AttachVolumeNegativeTest-2129882576 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:17:07 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-8d81a904-ce6e-4d41-983a-b4013c3046b1 tempest-AttachVolumeNegativeTest-2129882576 None] Deleted volume successfully. Jun 30 16:17:07 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8d81a904-ce6e-4d41-983a-b4013c3046b1 tempest-AttachVolumeNegativeTest-2129882576 None] Lock "cinder-ab86245d-71d0-4e59-b5fe-4ae8861543e5-delete_volume" released by "delete_volume" :: held 3.043s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:07 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3a6e2969-a8cd-42a2-a52b-b7533bfa2f8f tempest-VolumesActionsTest-459556707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.905s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:07 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-3a6e2969-a8cd-42a2-a52b-b7533bfa2f8f tempest-VolumesActionsTest-459556707 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:17:07 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-3a6e2969-a8cd-42a2-a52b-b7533bfa2f8f tempest-VolumesActionsTest-459556707 None] Deleted volume successfully. Jun 30 16:17:07 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3a6e2969-a8cd-42a2-a52b-b7533bfa2f8f tempest-VolumesActionsTest-459556707 None] Lock "cinder-dd0ce268-c94d-46d1-96ca-32ce8931f716-delete_volume" released by "delete_volume" :: held 3.294s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:07 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7121ae8e-4dd0-4ceb-911d-e4c4e10716ac tempest-AttachVolumeNegativeTest-2129882576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf" returned: 0 in 1.027s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7121ae8e-4dd0-4ceb-911d-e4c4e10716ac tempest-AttachVolumeNegativeTest-2129882576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:08 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf Jun 30 16:17:08 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:08 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7121ae8e-4dd0-4ceb-911d-e4c4e10716ac tempest-AttachVolumeNegativeTest-2129882576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf" returned: 0 in 0.887s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:08 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7121ae8e-4dd0-4ceb-911d-e4c4e10716ac tempest-AttachVolumeNegativeTest-2129882576 None] Lock "cinder-quobyte-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf" released by "delete_volume" :: held 1.982s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:08 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-7121ae8e-4dd0-4ceb-911d-e4c4e10716ac tempest-AttachVolumeNegativeTest-2129882576 None] Created reservations ['0106b7c1-4352-467f-9a1e-5d2ef5560c4f', '877f64af-cb0f-4216-a80f-8710aa3b9224', '3a9ba680-7b11-4b79-ba68-ff6ed2b3d60c', '4a91c60a-8299-43cd-bd79-d3fe61379c0b'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:17:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7121ae8e-4dd0-4ceb-911d-e4c4e10716ac tempest-AttachVolumeNegativeTest-2129882576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7121ae8e-4dd0-4ceb-911d-e4c4e10716ac tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-7121ae8e-4dd0-4ceb-911d-e4c4e10716ac tempest-AttachVolumeNegativeTest-2129882576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:17:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-7121ae8e-4dd0-4ceb-911d-e4c4e10716ac tempest-AttachVolumeNegativeTest-2129882576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:17:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7121ae8e-4dd0-4ceb-911d-e4c4e10716ac tempest-AttachVolumeNegativeTest-2129882576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7121ae8e-4dd0-4ceb-911d-e4c4e10716ac tempest-AttachVolumeNegativeTest-2129882576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:09 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:17:09 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:09 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7121ae8e-4dd0-4ceb-911d-e4c4e10716ac tempest-AttachVolumeNegativeTest-2129882576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.668s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:09 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-7121ae8e-4dd0-4ceb-911d-e4c4e10716ac tempest-AttachVolumeNegativeTest-2129882576 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:17:09 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-7121ae8e-4dd0-4ceb-911d-e4c4e10716ac tempest-AttachVolumeNegativeTest-2129882576 None] Deleted volume successfully. Jun 30 16:17:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7121ae8e-4dd0-4ceb-911d-e4c4e10716ac tempest-AttachVolumeNegativeTest-2129882576 None] Lock "cinder-18b1799b-0f9b-43ad-82f2-78cdaf5fbfbf-delete_volume" released by "delete_volume" :: held 2.905s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:14 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:17:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Flow 'volume_create_manager' (9913f42a-f160-46a1-b031-e35dd60c566a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:17:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a33661d-2f22-4a0c-93a5-aa9df0d7dc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a33661d-2f22-4a0c-93a5-aa9df0d7dc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1729786868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa08aa7-43b3-42a8-9cec-2f3f78cdce67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528a5e7dceb143169d0bad617fa01e10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:17:14Z,use_quota=True,user_id='530f09ec6fb1475fba1c05b072c60f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b9d0586-99b1-443f-af8a-8f94f38864ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b9d0586-99b1-443f-af8a-8f94f38864ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d60374a0-2ce9-464b-a72d-9ff0e4e30a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d60374a0-2ce9-464b-a72d-9ff0e4e30a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fa08aa7-43b3-42a8-9cec-2f3f78cdce67', 'volume_name': 'volume-3fa08aa7-43b3-42a8-9cec-2f3f78cdce67', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28107a9e-da39-42fc-8d38-76c22985261d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28107a9e-da39-42fc-8d38-76c22985261d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83391d74-14bd-4e4c-82ff-eddd14cc9c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:14 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Volume 3fa08aa7-43b3-42a8-9cec-2f3f78cdce67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fa08aa7-43b3-42a8-9cec-2f3f78cdce67', 'volume_size': 1} Jun 30 16:17:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1729786868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa08aa7-43b3-42a8-9cec-2f3f78cdce67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528a5e7dceb143169d0bad617fa01e10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:17:14Z,use_quota=True,user_id='530f09ec6fb1475fba1c05b072c60f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:17:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Creating volume 3fa08aa7-43b3-42a8-9cec-2f3f78cdce67 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:17:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:17:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:17:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:17:14 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:17:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3fa08aa7-43b3-42a8-9cec-2f3f78cdce67 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:14 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3fa08aa7-43b3-42a8-9cec-2f3f78cdce67 1073741824 Jun 30 16:17:14 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:15 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3fa08aa7-43b3-42a8-9cec-2f3f78cdce67 1073741824" returned: 0 in 1.062s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3fa08aa7-43b3-42a8-9cec-2f3f78cdce67 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:15 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3fa08aa7-43b3-42a8-9cec-2f3f78cdce67 Jun 30 16:17:15 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:16 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3fa08aa7-43b3-42a8-9cec-2f3f78cdce67" returned: 0 in 0.671s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:16 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:17:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83391d74-14bd-4e4c-82ff-eddd14cc9c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fa08aa7-43b3-42a8-9cec-2f3f78cdce67', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3467158f-a8a3-4992-a280-aef8245c2dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:16 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Volume volume-3fa08aa7-43b3-42a8-9cec-2f3f78cdce67 (3fa08aa7-43b3-42a8-9cec-2f3f78cdce67): created successfully Jun 30 16:17:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3467158f-a8a3-4992-a280-aef8245c2dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Flow 'volume_create_manager' (9913f42a-f160-46a1-b031-e35dd60c566a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:17:16 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-51aed423-3822-47cc-9faf-e5beef1fb52d tempest-VolumesActionsTest-459556707 None] Created volume successfully. Jun 30 16:17:16 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3cd41dcf-98b6-4351-9e34-0dc4e9af8114 tempest-VolumesActionsTest-1656490605 None] Acquiring lock "cinder-3fa08aa7-43b3-42a8-9cec-2f3f78cdce67-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:16 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3cd41dcf-98b6-4351-9e34-0dc4e9af8114 tempest-VolumesActionsTest-1656490605 None] Lock "cinder-3fa08aa7-43b3-42a8-9cec-2f3f78cdce67-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:16 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3cd41dcf-98b6-4351-9e34-0dc4e9af8114 tempest-VolumesActionsTest-1656490605 None] Acquiring lock "cinder-quobyte-3fa08aa7-43b3-42a8-9cec-2f3f78cdce67" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:16 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3cd41dcf-98b6-4351-9e34-0dc4e9af8114 tempest-VolumesActionsTest-1656490605 None] Lock "cinder-quobyte-3fa08aa7-43b3-42a8-9cec-2f3f78cdce67" acquired by "delete_volume" :: waited 0.017s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:16 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0dbd72-d553-4d7f-aa1e-810cf5172d06]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:17:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3cd41dcf-98b6-4351-9e34-0dc4e9af8114 tempest-VolumesActionsTest-1656490605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3fa08aa7-43b3-42a8-9cec-2f3f78cdce67 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:16 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3fa08aa7-43b3-42a8-9cec-2f3f78cdce67 Jun 30 16:17:16 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:17 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-83863220-c071-43b6-b2da-3773d435885e tempest-GroupsV320Test-828829015 None] Group tempest-GroupsV320Test-Group-1286705049: creating Jun 30 16:17:17 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-83863220-c071-43b6-b2da-3773d435885e tempest-GroupsV320Test-828829015 None] Group tempest-GroupsV320Test-Group-1286705049: created successfully Jun 30 16:17:17 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-83863220-c071-43b6-b2da-3773d435885e tempest-GroupsV320Test-828829015 None] Create group completed successfully. Jun 30 16:17:17 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3cd41dcf-98b6-4351-9e34-0dc4e9af8114 tempest-VolumesActionsTest-1656490605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3fa08aa7-43b3-42a8-9cec-2f3f78cdce67" returned: 0 in 0.859s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3cd41dcf-98b6-4351-9e34-0dc4e9af8114 tempest-VolumesActionsTest-1656490605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3fa08aa7-43b3-42a8-9cec-2f3f78cdce67 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:17 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3fa08aa7-43b3-42a8-9cec-2f3f78cdce67 Jun 30 16:17:17 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:18 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3cd41dcf-98b6-4351-9e34-0dc4e9af8114 tempest-VolumesActionsTest-1656490605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3fa08aa7-43b3-42a8-9cec-2f3f78cdce67" returned: 0 in 0.677s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:18 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3cd41dcf-98b6-4351-9e34-0dc4e9af8114 tempest-VolumesActionsTest-1656490605 None] Lock "cinder-quobyte-3fa08aa7-43b3-42a8-9cec-2f3f78cdce67" released by "delete_volume" :: held 1.591s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:18 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-3cd41dcf-98b6-4351-9e34-0dc4e9af8114 tempest-VolumesActionsTest-1656490605 None] Created reservations ['f4faad83-d2af-466a-b6fe-94e627b42c92', '5a4bbfbb-79b5-4bad-a6f5-71a64aff019c', 'acb03af1-b4ad-4508-ac6c-65d59f3a57cc', '7cb87bc8-b29a-4e94-a6b1-215be131e767'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:17:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3cd41dcf-98b6-4351-9e34-0dc4e9af8114 tempest-VolumesActionsTest-1656490605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3cd41dcf-98b6-4351-9e34-0dc4e9af8114 tempest-VolumesActionsTest-1656490605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:18 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3cd41dcf-98b6-4351-9e34-0dc4e9af8114 tempest-VolumesActionsTest-1656490605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:17:18 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3cd41dcf-98b6-4351-9e34-0dc4e9af8114 tempest-VolumesActionsTest-1656490605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:17:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3cd41dcf-98b6-4351-9e34-0dc4e9af8114 tempest-VolumesActionsTest-1656490605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3cd41dcf-98b6-4351-9e34-0dc4e9af8114 tempest-VolumesActionsTest-1656490605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:18 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:17:18 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:19 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3cd41dcf-98b6-4351-9e34-0dc4e9af8114 tempest-VolumesActionsTest-1656490605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.666s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-3cd41dcf-98b6-4351-9e34-0dc4e9af8114 tempest-VolumesActionsTest-1656490605 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:17:19 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-3cd41dcf-98b6-4351-9e34-0dc4e9af8114 tempest-VolumesActionsTest-1656490605 None] Deleted volume successfully. Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3cd41dcf-98b6-4351-9e34-0dc4e9af8114 tempest-VolumesActionsTest-1656490605 None] Lock "cinder-3fa08aa7-43b3-42a8-9cec-2f3f78cdce67-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-cf35b4f7-694f-47f0-83c2-3dc71e95579e tempest-GroupsV320Test-828829015 None] Created reservations ['ce80fa2a-6d4b-4351-878e-f7e5c8f76851'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cf35b4f7-694f-47f0-83c2-3dc71e95579e tempest-GroupsV320Test-828829015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cf35b4f7-694f-47f0-83c2-3dc71e95579e tempest-GroupsV320Test-828829015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cf35b4f7-694f-47f0-83c2-3dc71e95579e tempest-GroupsV320Test-828829015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cf35b4f7-694f-47f0-83c2-3dc71e95579e tempest-GroupsV320Test-828829015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cf35b4f7-694f-47f0-83c2-3dc71e95579e tempest-GroupsV320Test-828829015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf35b4f7-694f-47f0-83c2-3dc71e95579e tempest-GroupsV320Test-828829015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:19 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:17:19 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Flow 'volume_create_manager' (e8c85649-be45-43a9-a442-835191ce0aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7d2ff2-7816-4952-8d65-4632d40b8702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7d2ff2-7816-4952-8d65-4632d40b8702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2013281631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585e4bb7-f9d6-4970-b0a1-6b52c0362781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528a5e7dceb143169d0bad617fa01e10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:17:19Z,use_quota=True,user_id='530f09ec6fb1475fba1c05b072c60f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252dd111-cb4c-44f3-96d4-a667c80469bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252dd111-cb4c-44f3-96d4-a667c80469bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf21c769-09c3-4470-8f90-09cc60abc686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf21c769-09c3-4470-8f90-09cc60abc686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '585e4bb7-f9d6-4970-b0a1-6b52c0362781', 'volume_name': 'volume-585e4bb7-f9d6-4970-b0a1-6b52c0362781', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8138a811-6bfb-4e79-adca-8df8d8101a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8138a811-6bfb-4e79-adca-8df8d8101a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1518e76-b66e-4917-8bae-8aa150c2730a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:19 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Volume 585e4bb7-f9d6-4970-b0a1-6b52c0362781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-585e4bb7-f9d6-4970-b0a1-6b52c0362781', 'volume_size': 1} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2013281631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585e4bb7-f9d6-4970-b0a1-6b52c0362781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528a5e7dceb143169d0bad617fa01e10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:17:19Z,use_quota=True,user_id='530f09ec6fb1475fba1c05b072c60f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Creating volume 585e4bb7-f9d6-4970-b0a1-6b52c0362781 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:17:19 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-585e4bb7-f9d6-4970-b0a1-6b52c0362781 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:19 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-585e4bb7-f9d6-4970-b0a1-6b52c0362781 1073741824 Jun 30 16:17:19 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:19 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf35b4f7-694f-47f0-83c2-3dc71e95579e tempest-GroupsV320Test-828829015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.677s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:19 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-cf35b4f7-694f-47f0-83c2-3dc71e95579e tempest-GroupsV320Test-828829015 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:17:19 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-cf35b4f7-694f-47f0-83c2-3dc71e95579e tempest-GroupsV320Test-828829015 None] Delete group completed successfully. Jun 30 16:17:20 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-585e4bb7-f9d6-4970-b0a1-6b52c0362781 1073741824" returned: 0 in 0.897s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-585e4bb7-f9d6-4970-b0a1-6b52c0362781 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:20 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-585e4bb7-f9d6-4970-b0a1-6b52c0362781 Jun 30 16:17:20 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:21 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-585e4bb7-f9d6-4970-b0a1-6b52c0362781" returned: 0 in 0.696s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:17:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1518e76-b66e-4917-8bae-8aa150c2730a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-585e4bb7-f9d6-4970-b0a1-6b52c0362781', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd5f97f-84cb-4b65-a56f-0b9245672dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:21 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Volume volume-585e4bb7-f9d6-4970-b0a1-6b52c0362781 (585e4bb7-f9d6-4970-b0a1-6b52c0362781): created successfully Jun 30 16:17:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd5f97f-84cb-4b65-a56f-0b9245672dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Flow 'volume_create_manager' (e8c85649-be45-43a9-a442-835191ce0aa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:17:21 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-b97ee410-f7f4-4d45-8cdc-69f865d1ebd0 tempest-VolumesActionsTest-459556707 None] Created volume successfully. Jun 30 16:17:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-608b712d-2e7b-4419-be8f-b58071a28744 tempest-VolumesActionsTest-1656490605 None] Acquiring lock "cinder-585e4bb7-f9d6-4970-b0a1-6b52c0362781-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-608b712d-2e7b-4419-be8f-b58071a28744 tempest-VolumesActionsTest-1656490605 None] Lock "cinder-585e4bb7-f9d6-4970-b0a1-6b52c0362781-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-608b712d-2e7b-4419-be8f-b58071a28744 tempest-VolumesActionsTest-1656490605 None] Acquiring lock "cinder-quobyte-585e4bb7-f9d6-4970-b0a1-6b52c0362781" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-608b712d-2e7b-4419-be8f-b58071a28744 tempest-VolumesActionsTest-1656490605 None] Lock "cinder-quobyte-585e4bb7-f9d6-4970-b0a1-6b52c0362781" acquired by "delete_volume" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:21 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[195f7547-5e2e-4000-b4dc-452225025057]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:17:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-608b712d-2e7b-4419-be8f-b58071a28744 tempest-VolumesActionsTest-1656490605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-585e4bb7-f9d6-4970-b0a1-6b52c0362781 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:21 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-585e4bb7-f9d6-4970-b0a1-6b52c0362781 Jun 30 16:17:21 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:22 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-608b712d-2e7b-4419-be8f-b58071a28744 tempest-VolumesActionsTest-1656490605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-585e4bb7-f9d6-4970-b0a1-6b52c0362781" returned: 0 in 0.894s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-608b712d-2e7b-4419-be8f-b58071a28744 tempest-VolumesActionsTest-1656490605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-585e4bb7-f9d6-4970-b0a1-6b52c0362781 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:22 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-585e4bb7-f9d6-4970-b0a1-6b52c0362781 Jun 30 16:17:22 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:23 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-608b712d-2e7b-4419-be8f-b58071a28744 tempest-VolumesActionsTest-1656490605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-585e4bb7-f9d6-4970-b0a1-6b52c0362781" returned: 0 in 0.786s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-608b712d-2e7b-4419-be8f-b58071a28744 tempest-VolumesActionsTest-1656490605 None] Lock "cinder-quobyte-585e4bb7-f9d6-4970-b0a1-6b52c0362781" released by "delete_volume" :: held 1.733s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:23 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-608b712d-2e7b-4419-be8f-b58071a28744 tempest-VolumesActionsTest-1656490605 None] Created reservations ['fa36ffa3-7e83-4382-835f-52b3efa2eb1a', '19e9d8fd-5114-4254-b63f-fe6e38af50bc', 'f5817bc0-ff5c-4568-acb6-928c74a104a9', 'fda6db5d-3210-41d8-bce4-fdd4db55aa86'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:17:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-608b712d-2e7b-4419-be8f-b58071a28744 tempest-VolumesActionsTest-1656490605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-608b712d-2e7b-4419-be8f-b58071a28744 tempest-VolumesActionsTest-1656490605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-608b712d-2e7b-4419-be8f-b58071a28744 tempest-VolumesActionsTest-1656490605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:17:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-608b712d-2e7b-4419-be8f-b58071a28744 tempest-VolumesActionsTest-1656490605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:17:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-608b712d-2e7b-4419-be8f-b58071a28744 tempest-VolumesActionsTest-1656490605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-608b712d-2e7b-4419-be8f-b58071a28744 tempest-VolumesActionsTest-1656490605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:23 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:17:23 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:24 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-608b712d-2e7b-4419-be8f-b58071a28744 tempest-VolumesActionsTest-1656490605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.740s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-608b712d-2e7b-4419-be8f-b58071a28744 tempest-VolumesActionsTest-1656490605 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:17:24 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-608b712d-2e7b-4419-be8f-b58071a28744 tempest-VolumesActionsTest-1656490605 None] Deleted volume successfully. Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-608b712d-2e7b-4419-be8f-b58071a28744 tempest-VolumesActionsTest-1656490605 None] Lock "cinder-585e4bb7-f9d6-4970-b0a1-6b52c0362781-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Flow 'volume_create_manager' (1bec5626-f2b9-462f-a722-de0f7aa39600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc922e6-cf38-440f-9709-87e10f3754b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc922e6-cf38-440f-9709-87e10f3754b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-942375096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36452fb1-bea9-49cb-b0ef-d4f6f76f9292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528a5e7dceb143169d0bad617fa01e10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:17:25Z,use_quota=True,user_id='530f09ec6fb1475fba1c05b072c60f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6f9b74-38d4-4d47-8969-914544e7fe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6f9b74-38d4-4d47-8969-914544e7fe64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0865c461-4c94-4015-a8c3-581e2f48fc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0865c461-4c94-4015-a8c3-581e2f48fc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36452fb1-bea9-49cb-b0ef-d4f6f76f9292', 'volume_name': 'volume-36452fb1-bea9-49cb-b0ef-d4f6f76f9292', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1fbaef-012c-49f0-a2b7-bd52de187b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1fbaef-012c-49f0-a2b7-bd52de187b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405e4cf0-485d-4fd7-bc1a-c62c11861d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:24 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Volume 36452fb1-bea9-49cb-b0ef-d4f6f76f9292: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36452fb1-bea9-49cb-b0ef-d4f6f76f9292', 'volume_size': 1} Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-942375096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36452fb1-bea9-49cb-b0ef-d4f6f76f9292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528a5e7dceb143169d0bad617fa01e10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:17:25Z,use_quota=True,user_id='530f09ec6fb1475fba1c05b072c60f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Creating volume 36452fb1-bea9-49cb-b0ef-d4f6f76f9292 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:17:24 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:17:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-36452fb1-bea9-49cb-b0ef-d4f6f76f9292 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:24 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-36452fb1-bea9-49cb-b0ef-d4f6f76f9292 1073741824 Jun 30 16:17:24 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:25 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-36452fb1-bea9-49cb-b0ef-d4f6f76f9292 1073741824" returned: 0 in 0.915s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-36452fb1-bea9-49cb-b0ef-d4f6f76f9292 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:25 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-36452fb1-bea9-49cb-b0ef-d4f6f76f9292 Jun 30 16:17:25 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:26 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-36452fb1-bea9-49cb-b0ef-d4f6f76f9292" returned: 0 in 0.635s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:26 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:17:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:26 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405e4cf0-485d-4fd7-bc1a-c62c11861d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36452fb1-bea9-49cb-b0ef-d4f6f76f9292', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:26 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f243fc3e-c608-487f-b7c1-882747381f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:26 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Volume volume-36452fb1-bea9-49cb-b0ef-d4f6f76f9292 (36452fb1-bea9-49cb-b0ef-d4f6f76f9292): created successfully Jun 30 16:17:26 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f243fc3e-c608-487f-b7c1-882747381f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:26 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Flow 'volume_create_manager' (1bec5626-f2b9-462f-a722-de0f7aa39600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:17:26 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-24a42a4e-50f7-4da2-82c0-6758e1ba9e21 tempest-VolumesActionsTest-459556707 None] Created volume successfully. Jun 30 16:17:26 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cfd34e02-3131-499d-8888-e9e2b9b8e304 tempest-VolumesActionsTest-1656490605 None] Acquiring lock "cinder-36452fb1-bea9-49cb-b0ef-d4f6f76f9292-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:26 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cfd34e02-3131-499d-8888-e9e2b9b8e304 tempest-VolumesActionsTest-1656490605 None] Lock "cinder-36452fb1-bea9-49cb-b0ef-d4f6f76f9292-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:26 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cfd34e02-3131-499d-8888-e9e2b9b8e304 tempest-VolumesActionsTest-1656490605 None] Acquiring lock "cinder-quobyte-36452fb1-bea9-49cb-b0ef-d4f6f76f9292" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:26 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cfd34e02-3131-499d-8888-e9e2b9b8e304 tempest-VolumesActionsTest-1656490605 None] Lock "cinder-quobyte-36452fb1-bea9-49cb-b0ef-d4f6f76f9292" acquired by "delete_volume" :: waited 0.016s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:27 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[68284c05-1434-4821-b84b-fac37ac1ff7b]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:17:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cfd34e02-3131-499d-8888-e9e2b9b8e304 tempest-VolumesActionsTest-1656490605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-36452fb1-bea9-49cb-b0ef-d4f6f76f9292 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:27 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-36452fb1-bea9-49cb-b0ef-d4f6f76f9292 Jun 30 16:17:27 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:27 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cfd34e02-3131-499d-8888-e9e2b9b8e304 tempest-VolumesActionsTest-1656490605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-36452fb1-bea9-49cb-b0ef-d4f6f76f9292" returned: 0 in 0.952s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cfd34e02-3131-499d-8888-e9e2b9b8e304 tempest-VolumesActionsTest-1656490605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-36452fb1-bea9-49cb-b0ef-d4f6f76f9292 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:28 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-36452fb1-bea9-49cb-b0ef-d4f6f76f9292 Jun 30 16:17:28 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:28 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cfd34e02-3131-499d-8888-e9e2b9b8e304 tempest-VolumesActionsTest-1656490605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-36452fb1-bea9-49cb-b0ef-d4f6f76f9292" returned: 0 in 0.773s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:28 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cfd34e02-3131-499d-8888-e9e2b9b8e304 tempest-VolumesActionsTest-1656490605 None] Lock "cinder-quobyte-36452fb1-bea9-49cb-b0ef-d4f6f76f9292" released by "delete_volume" :: held 1.781s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:28 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-cfd34e02-3131-499d-8888-e9e2b9b8e304 tempest-VolumesActionsTest-1656490605 None] Created reservations ['08119e12-2060-41c4-ab1a-9cae2a50ccdf', '29b5c198-ddac-483e-8186-16f22509db41', '4573f8a0-4a25-48f4-9e32-ffc1a4c16572', 'f557473b-fd4b-4337-ae82-d235c64589ea'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:17:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cfd34e02-3131-499d-8888-e9e2b9b8e304 tempest-VolumesActionsTest-1656490605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cfd34e02-3131-499d-8888-e9e2b9b8e304 tempest-VolumesActionsTest-1656490605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:28 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cfd34e02-3131-499d-8888-e9e2b9b8e304 tempest-VolumesActionsTest-1656490605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:17:28 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cfd34e02-3131-499d-8888-e9e2b9b8e304 tempest-VolumesActionsTest-1656490605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:17:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cfd34e02-3131-499d-8888-e9e2b9b8e304 tempest-VolumesActionsTest-1656490605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cfd34e02-3131-499d-8888-e9e2b9b8e304 tempest-VolumesActionsTest-1656490605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:28 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:17:28 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:29 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cfd34e02-3131-499d-8888-e9e2b9b8e304 tempest-VolumesActionsTest-1656490605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.772s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:29 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-cfd34e02-3131-499d-8888-e9e2b9b8e304 tempest-VolumesActionsTest-1656490605 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:17:29 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-cfd34e02-3131-499d-8888-e9e2b9b8e304 tempest-VolumesActionsTest-1656490605 None] Deleted volume successfully. Jun 30 16:17:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cfd34e02-3131-499d-8888-e9e2b9b8e304 tempest-VolumesActionsTest-1656490605 None] Lock "cinder-36452fb1-bea9-49cb-b0ef-d4f6f76f9292-delete_volume" released by "delete_volume" :: held 2.831s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:29 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:17:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Flow 'volume_create_manager' (adbf7fb4-52b1-4bb7-82fd-e58a2492d634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:17:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d144f9-1b8d-4335-8815-b40f347abd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d144f9-1b8d-4335-8815-b40f347abd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2030195046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528a5e7dceb143169d0bad617fa01e10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:17:30Z,use_quota=True,user_id='530f09ec6fb1475fba1c05b072c60f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb52d93-07ea-476c-bf44-069259149b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb52d93-07ea-476c-bf44-069259149b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b37fa3f-8c28-4316-b24d-b70c1cea4b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b37fa3f-8c28-4316-b24d-b70c1cea4b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4', 'volume_name': 'volume-c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (951d81c2-d04a-40ba-9eef-5e5284189585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (951d81c2-d04a-40ba-9eef-5e5284189585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d8fdf1-903c-44b3-a2aa-4a12fce704b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:30 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Volume c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4', 'volume_size': 1} Jun 30 16:17:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2030195046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528a5e7dceb143169d0bad617fa01e10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:17:30Z,use_quota=True,user_id='530f09ec6fb1475fba1c05b072c60f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:17:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Creating volume c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:17:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:17:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:17:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:17:30 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:17:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:30 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4 1073741824 Jun 30 16:17:30 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:31 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4 1073741824" returned: 0 in 1.085s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:31 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4 Jun 30 16:17:31 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:31 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4" returned: 0 in 0.649s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:17:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d8fdf1-903c-44b3-a2aa-4a12fce704b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa2c5b6-ebf7-4932-9203-72dd666d1c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:31 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Volume volume-c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4 (c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4): created successfully Jun 30 16:17:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa2c5b6-ebf7-4932-9203-72dd666d1c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Flow 'volume_create_manager' (adbf7fb4-52b1-4bb7-82fd-e58a2492d634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:17:31 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-9d38e46e-4588-4f2e-88a2-a6593e6666a9 tempest-VolumesActionsTest-459556707 None] Created volume successfully. Jun 30 16:17:32 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:17:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Flow 'volume_create_manager' (db0c8349-6c19-49eb-8955-60f96678cec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:17:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bca2d1c-7d67-4ff1-bee6-fe4f939c6029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bca2d1c-7d67-4ff1-bee6-fe4f939c6029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-848832372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31230ec0-aa4e-49d8-bf04-1c176e79218d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f963b411673d469888752944c5c0f271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:17:33Z,use_quota=True,user_id='0976b61176ea4e8babc3166f8b86fac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a7b3112-a331-4d05-ac06-e37977a2f6ed),volume_type_id=9a7b3112-a331-4d05-ac06-e37977a2f6ed)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520bd3c3-c08c-414a-9573-ec4c72e840ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520bd3c3-c08c-414a-9573-ec4c72e840ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd4bb9c-230d-4c48-bead-0d83ed3abc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd4bb9c-230d-4c48-bead-0d83ed3abc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31230ec0-aa4e-49d8-bf04-1c176e79218d', 'volume_name': 'volume-31230ec0-aa4e-49d8-bf04-1c176e79218d', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44070af3-83c7-408c-8a96-2055edb9eb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44070af3-83c7-408c-8a96-2055edb9eb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:32 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35329bb0-6294-45d2-bf9c-70d1c14f4c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:32 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Volume 31230ec0-aa4e-49d8-bf04-1c176e79218d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31230ec0-aa4e-49d8-bf04-1c176e79218d', 'volume_size': 1} Jun 30 16:17:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-848832372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31230ec0-aa4e-49d8-bf04-1c176e79218d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f963b411673d469888752944c5c0f271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:17:33Z,use_quota=True,user_id='0976b61176ea4e8babc3166f8b86fac2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a7b3112-a331-4d05-ac06-e37977a2f6ed),volume_type_id=9a7b3112-a331-4d05-ac06-e37977a2f6ed)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:17:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Creating volume 31230ec0-aa4e-49d8-bf04-1c176e79218d {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:17:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:17:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:17:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:17:32 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:17:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-31230ec0-aa4e-49d8-bf04-1c176e79218d 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:32 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-31230ec0-aa4e-49d8-bf04-1c176e79218d 1073741824 Jun 30 16:17:32 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:17:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:17:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:17:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:33 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:17:33 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ea078908-66c4-4de8-9f77-92a11425db5d tempest-VolumesActionsTest-1656490605 None] Acquiring lock "cinder-c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ea078908-66c4-4de8-9f77-92a11425db5d tempest-VolumesActionsTest-1656490605 None] Lock "cinder-c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ea078908-66c4-4de8-9f77-92a11425db5d tempest-VolumesActionsTest-1656490605 None] Acquiring lock "cinder-quobyte-c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ea078908-66c4-4de8-9f77-92a11425db5d tempest-VolumesActionsTest-1656490605 None] Lock "cinder-quobyte-c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4" acquired by "delete_volume" :: waited 0.016s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:33 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[252a7632-3cee-40f7-b04a-3c42e6509186]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:17:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ea078908-66c4-4de8-9f77-92a11425db5d tempest-VolumesActionsTest-1656490605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:33 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4 Jun 30 16:17:33 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:33 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-31230ec0-aa4e-49d8-bf04-1c176e79218d 1073741824" returned: 0 in 0.956s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-31230ec0-aa4e-49d8-bf04-1c176e79218d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:33 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-31230ec0-aa4e-49d8-bf04-1c176e79218d Jun 30 16:17:33 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:33 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.784s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:33 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:17:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:17:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 28 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:17:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:17:34 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ea078908-66c4-4de8-9f77-92a11425db5d tempest-VolumesActionsTest-1656490605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4" returned: 0 in 0.942s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ea078908-66c4-4de8-9f77-92a11425db5d tempest-VolumesActionsTest-1656490605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:34 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4 Jun 30 16:17:34 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:34 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-31230ec0-aa4e-49d8-bf04-1c176e79218d" returned: 0 in 0.772s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:17:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35329bb0-6294-45d2-bf9c-70d1c14f4c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31230ec0-aa4e-49d8-bf04-1c176e79218d', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a458f26-a764-4163-b23a-cf0877d33fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:34 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Volume volume-31230ec0-aa4e-49d8-bf04-1c176e79218d (31230ec0-aa4e-49d8-bf04-1c176e79218d): created successfully Jun 30 16:17:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a458f26-a764-4163-b23a-cf0877d33fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Flow 'volume_create_manager' (db0c8349-6c19-49eb-8955-60f96678cec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:17:34 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-9f4377c1-4fdf-407d-8014-48efc36bc64b tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Created volume successfully. Jun 30 16:17:34 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ea078908-66c4-4de8-9f77-92a11425db5d tempest-VolumesActionsTest-1656490605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4" returned: 0 in 0.708s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:34 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ea078908-66c4-4de8-9f77-92a11425db5d tempest-VolumesActionsTest-1656490605 None] Lock "cinder-quobyte-c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4" released by "delete_volume" :: held 1.702s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:35 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-ea078908-66c4-4de8-9f77-92a11425db5d tempest-VolumesActionsTest-1656490605 None] Created reservations ['8a79c669-075e-4a52-8a3a-4d5f992c4355', '1d89050d-4a70-49f7-84c6-b3aba3a2f597', 'd15bda90-068d-430e-a864-e70a49bca144', '2132e6a4-84f4-4036-9583-fa446b012e78'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:17:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ea078908-66c4-4de8-9f77-92a11425db5d tempest-VolumesActionsTest-1656490605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ea078908-66c4-4de8-9f77-92a11425db5d tempest-VolumesActionsTest-1656490605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:35 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ea078908-66c4-4de8-9f77-92a11425db5d tempest-VolumesActionsTest-1656490605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:17:35 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ea078908-66c4-4de8-9f77-92a11425db5d tempest-VolumesActionsTest-1656490605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:17:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ea078908-66c4-4de8-9f77-92a11425db5d tempest-VolumesActionsTest-1656490605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ea078908-66c4-4de8-9f77-92a11425db5d tempest-VolumesActionsTest-1656490605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:35 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:17:35 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-001fbea7-b571-4e0a-809d-6620a722d2da tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-001fbea7-b571-4e0a-809d-6620a722d2da tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:35 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-001fbea7-b571-4e0a-809d-6620a722d2da tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:17:35 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-001fbea7-b571-4e0a-809d-6620a722d2da tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:17:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-001fbea7-b571-4e0a-809d-6620a722d2da tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-001fbea7-b571-4e0a-809d-6620a722d2da tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:35 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:17:35 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:35 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-001fbea7-b571-4e0a-809d-6620a722d2da tempest-VolumeRetypeWithoutMigrationTest-173384370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.751s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:35 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-001fbea7-b571-4e0a-809d-6620a722d2da tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:17:36 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-001fbea7-b571-4e0a-809d-6620a722d2da tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Retype volume completed successfully. Jun 30 16:17:36 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ea078908-66c4-4de8-9f77-92a11425db5d tempest-VolumesActionsTest-1656490605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.844s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-ea078908-66c4-4de8-9f77-92a11425db5d tempest-VolumesActionsTest-1656490605 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:17:36 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-ea078908-66c4-4de8-9f77-92a11425db5d tempest-VolumesActionsTest-1656490605 None] Deleted volume successfully. Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ea078908-66c4-4de8-9f77-92a11425db5d tempest-VolumesActionsTest-1656490605 None] Lock "cinder-c0e2fe58-cbd1-49c1-a5e9-a939fd73dfd4-delete_volume" released by "delete_volume" :: held 2.824s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Flow 'volume_create_manager' (b4434824-23ef-42c9-aceb-c730816a8f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b1d8c11-5537-4d98-b819-cdc59b5dec53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b1d8c11-5537-4d98-b819-cdc59b5dec53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-506215294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621114ad-7d20-4176-ad2f-074a0e7d39ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528a5e7dceb143169d0bad617fa01e10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:17:36Z,use_quota=True,user_id='530f09ec6fb1475fba1c05b072c60f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b1a9ba-56ed-43f0-9cb6-f8788e6e4214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b1a9ba-56ed-43f0-9cb6-f8788e6e4214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98979170-b0eb-405b-94a3-6bd741d1e46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98979170-b0eb-405b-94a3-6bd741d1e46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '621114ad-7d20-4176-ad2f-074a0e7d39ce', 'volume_name': 'volume-621114ad-7d20-4176-ad2f-074a0e7d39ce', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61402575-ceba-4ee3-b4aa-7d6dbb1edad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61402575-ceba-4ee3-b4aa-7d6dbb1edad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101c99a9-c857-430f-bdde-623c73199d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:36 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Volume 621114ad-7d20-4176-ad2f-074a0e7d39ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-621114ad-7d20-4176-ad2f-074a0e7d39ce', 'volume_size': 1} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-506215294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621114ad-7d20-4176-ad2f-074a0e7d39ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528a5e7dceb143169d0bad617fa01e10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:17:36Z,use_quota=True,user_id='530f09ec6fb1475fba1c05b072c60f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Creating volume 621114ad-7d20-4176-ad2f-074a0e7d39ce {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:17:36 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-621114ad-7d20-4176-ad2f-074a0e7d39ce 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:36 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-621114ad-7d20-4176-ad2f-074a0e7d39ce 1073741824 Jun 30 16:17:36 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5a55645a-6fc0-4d0a-91b5-60ee00bce687 tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Acquiring lock "cinder-31230ec0-aa4e-49d8-bf04-1c176e79218d-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5a55645a-6fc0-4d0a-91b5-60ee00bce687 tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Lock "cinder-31230ec0-aa4e-49d8-bf04-1c176e79218d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5a55645a-6fc0-4d0a-91b5-60ee00bce687 tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Acquiring lock "cinder-quobyte-31230ec0-aa4e-49d8-bf04-1c176e79218d" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5a55645a-6fc0-4d0a-91b5-60ee00bce687 tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Lock "cinder-quobyte-31230ec0-aa4e-49d8-bf04-1c176e79218d" acquired by "delete_volume" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[1008a5fd-2465-4262-887b-c78706d591e2]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:17:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5a55645a-6fc0-4d0a-91b5-60ee00bce687 tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-31230ec0-aa4e-49d8-bf04-1c176e79218d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:36 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-31230ec0-aa4e-49d8-bf04-1c176e79218d Jun 30 16:17:36 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:37 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-621114ad-7d20-4176-ad2f-074a0e7d39ce 1073741824" returned: 0 in 0.874s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-621114ad-7d20-4176-ad2f-074a0e7d39ce {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:37 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-621114ad-7d20-4176-ad2f-074a0e7d39ce Jun 30 16:17:37 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:37 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5a55645a-6fc0-4d0a-91b5-60ee00bce687 tempest-VolumeRetypeWithoutMigrationTest-173384370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-31230ec0-aa4e-49d8-bf04-1c176e79218d" returned: 0 in 0.808s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5a55645a-6fc0-4d0a-91b5-60ee00bce687 tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-31230ec0-aa4e-49d8-bf04-1c176e79218d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:37 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-31230ec0-aa4e-49d8-bf04-1c176e79218d Jun 30 16:17:37 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:37 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-621114ad-7d20-4176-ad2f-074a0e7d39ce" returned: 0 in 0.681s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:17:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101c99a9-c857-430f-bdde-623c73199d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-621114ad-7d20-4176-ad2f-074a0e7d39ce', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (527eace1-b262-4ee4-9680-b68693c8eda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:37 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Volume volume-621114ad-7d20-4176-ad2f-074a0e7d39ce (621114ad-7d20-4176-ad2f-074a0e7d39ce): created successfully Jun 30 16:17:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (527eace1-b262-4ee4-9680-b68693c8eda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Flow 'volume_create_manager' (b4434824-23ef-42c9-aceb-c730816a8f99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:17:37 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-356ccab1-0965-4623-b9ef-4ca87cd27a56 tempest-VolumesActionsTest-459556707 None] Created volume successfully. Jun 30 16:17:38 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5a55645a-6fc0-4d0a-91b5-60ee00bce687 tempest-VolumeRetypeWithoutMigrationTest-173384370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-31230ec0-aa4e-49d8-bf04-1c176e79218d" returned: 0 in 0.662s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5a55645a-6fc0-4d0a-91b5-60ee00bce687 tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Lock "cinder-quobyte-31230ec0-aa4e-49d8-bf04-1c176e79218d" released by "delete_volume" :: held 1.518s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:38 devstack cinder-volume[93781]: WARNING cinder.quota [None req-5a55645a-6fc0-4d0a-91b5-60ee00bce687 tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:17:38 devstack cinder-volume[93781]: WARNING cinder.quota [None req-5a55645a-6fc0-4d0a-91b5-60ee00bce687 tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:17:38 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-5a55645a-6fc0-4d0a-91b5-60ee00bce687 tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Created reservations ['2887be4a-7ccb-44dc-9700-d80e26528893', '40745e43-8c87-474c-ab07-919663729974', '80804890-9d4b-439b-9c52-8b4ef250b617', '55c15c54-9e9b-4c31-a605-46f31814504c'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:17:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5a55645a-6fc0-4d0a-91b5-60ee00bce687 tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5a55645a-6fc0-4d0a-91b5-60ee00bce687 tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5a55645a-6fc0-4d0a-91b5-60ee00bce687 tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:17:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5a55645a-6fc0-4d0a-91b5-60ee00bce687 tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:17:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5a55645a-6fc0-4d0a-91b5-60ee00bce687 tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5a55645a-6fc0-4d0a-91b5-60ee00bce687 tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:38 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:17:38 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:38 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5a55645a-6fc0-4d0a-91b5-60ee00bce687 tempest-VolumeRetypeWithoutMigrationTest-173384370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.682s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:38 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-5a55645a-6fc0-4d0a-91b5-60ee00bce687 tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:17:38 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-5a55645a-6fc0-4d0a-91b5-60ee00bce687 tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Deleted volume successfully. Jun 30 16:17:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5a55645a-6fc0-4d0a-91b5-60ee00bce687 tempest-VolumeRetypeWithoutMigrationTest-173384370 None] Lock "cinder-31230ec0-aa4e-49d8-bf04-1c176e79218d-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-794b17b5-bb7c-4e55-99da-0c89a145b1c3 tempest-VolumesActionsTest-459556707 None] Acquiring lock "cinder-621114ad-7d20-4176-ad2f-074a0e7d39ce-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-794b17b5-bb7c-4e55-99da-0c89a145b1c3 tempest-VolumesActionsTest-459556707 None] Lock "cinder-621114ad-7d20-4176-ad2f-074a0e7d39ce-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-794b17b5-bb7c-4e55-99da-0c89a145b1c3 tempest-VolumesActionsTest-459556707 None] Acquiring lock "cinder-quobyte-621114ad-7d20-4176-ad2f-074a0e7d39ce" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-794b17b5-bb7c-4e55-99da-0c89a145b1c3 tempest-VolumesActionsTest-459556707 None] Lock "cinder-quobyte-621114ad-7d20-4176-ad2f-074a0e7d39ce" acquired by "delete_volume" :: waited 0.023s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:39 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aeb859e-5bee-4a22-ad7f-3553ffe515fb]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:17:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-794b17b5-bb7c-4e55-99da-0c89a145b1c3 tempest-VolumesActionsTest-459556707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-621114ad-7d20-4176-ad2f-074a0e7d39ce {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:39 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-621114ad-7d20-4176-ad2f-074a0e7d39ce Jun 30 16:17:39 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:39 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-794b17b5-bb7c-4e55-99da-0c89a145b1c3 tempest-VolumesActionsTest-459556707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-621114ad-7d20-4176-ad2f-074a0e7d39ce" returned: 0 in 0.835s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-794b17b5-bb7c-4e55-99da-0c89a145b1c3 tempest-VolumesActionsTest-459556707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-621114ad-7d20-4176-ad2f-074a0e7d39ce {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:39 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-621114ad-7d20-4176-ad2f-074a0e7d39ce Jun 30 16:17:39 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:40 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-794b17b5-bb7c-4e55-99da-0c89a145b1c3 tempest-VolumesActionsTest-459556707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-621114ad-7d20-4176-ad2f-074a0e7d39ce" returned: 0 in 0.812s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:40 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-794b17b5-bb7c-4e55-99da-0c89a145b1c3 tempest-VolumesActionsTest-459556707 None] Lock "cinder-quobyte-621114ad-7d20-4176-ad2f-074a0e7d39ce" released by "delete_volume" :: held 1.704s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:40 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-794b17b5-bb7c-4e55-99da-0c89a145b1c3 tempest-VolumesActionsTest-459556707 None] Created reservations ['8db7b132-11b2-4d7a-95d2-947a27d87237', '7ae35757-bef7-457c-823e-cd191ac7932f', 'ac71edca-b38a-4c7c-b5c0-e2ea801b89dc', 'a745adff-9cda-4051-93ff-5d703dba85cf'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:17:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-794b17b5-bb7c-4e55-99da-0c89a145b1c3 tempest-VolumesActionsTest-459556707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-794b17b5-bb7c-4e55-99da-0c89a145b1c3 tempest-VolumesActionsTest-459556707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-794b17b5-bb7c-4e55-99da-0c89a145b1c3 tempest-VolumesActionsTest-459556707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:17:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-794b17b5-bb7c-4e55-99da-0c89a145b1c3 tempest-VolumesActionsTest-459556707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:17:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-794b17b5-bb7c-4e55-99da-0c89a145b1c3 tempest-VolumesActionsTest-459556707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-794b17b5-bb7c-4e55-99da-0c89a145b1c3 tempest-VolumesActionsTest-459556707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:40 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:17:40 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:41 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-794b17b5-bb7c-4e55-99da-0c89a145b1c3 tempest-VolumesActionsTest-459556707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.848s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:41 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-794b17b5-bb7c-4e55-99da-0c89a145b1c3 tempest-VolumesActionsTest-459556707 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:17:41 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-794b17b5-bb7c-4e55-99da-0c89a145b1c3 tempest-VolumesActionsTest-459556707 None] Deleted volume successfully. Jun 30 16:17:41 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-794b17b5-bb7c-4e55-99da-0c89a145b1c3 tempest-VolumesActionsTest-459556707 None] Lock "cinder-621114ad-7d20-4176-ad2f-074a0e7d39ce-delete_volume" released by "delete_volume" :: held 2.861s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:46 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:17:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Flow 'volume_create_manager' (d4830958-cb07-4327-8251-4388cd1d6dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:17:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a08932b-dbf9-4aa9-8e0d-ac25f4a10de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a08932b-dbf9-4aa9-8e0d-ac25f4a10de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-920955292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cb95c40-34b1-4fd4-9334-49518f3047e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='204d424822854620858f23608481fb01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:17:46Z,use_quota=True,user_id='2d420421898645f1a152cd0a902f6e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6d3e6ee-8f9c-4097-b5ae-33eab8bc9657),volume_type_id=c6d3e6ee-8f9c-4097-b5ae-33eab8bc9657)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4d6e61-e6d9-4074-bbe7-89a3e8a93ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4d6e61-e6d9-4074-bbe7-89a3e8a93ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cdfc928-382d-440e-8d5f-2dd6bd34b109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cdfc928-382d-440e-8d5f-2dd6bd34b109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cb95c40-34b1-4fd4-9334-49518f3047e2', 'volume_name': 'volume-2cb95c40-34b1-4fd4-9334-49518f3047e2', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e651c5-654c-4d71-aa67-053be8fdf1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e651c5-654c-4d71-aa67-053be8fdf1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf9ce5d-cd78-4a22-936f-edc42814fda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:46 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Volume 2cb95c40-34b1-4fd4-9334-49518f3047e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cb95c40-34b1-4fd4-9334-49518f3047e2', 'volume_size': 1} Jun 30 16:17:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:46 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-920955292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cb95c40-34b1-4fd4-9334-49518f3047e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='204d424822854620858f23608481fb01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:17:46Z,use_quota=True,user_id='2d420421898645f1a152cd0a902f6e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6d3e6ee-8f9c-4097-b5ae-33eab8bc9657),volume_type_id=c6d3e6ee-8f9c-4097-b5ae-33eab8bc9657)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:17:46 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Creating volume 2cb95c40-34b1-4fd4-9334-49518f3047e2 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:17:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:46 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:17:46 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:17:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:46 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:17:46 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:17:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2cb95c40-34b1-4fd4-9334-49518f3047e2 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:46 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2cb95c40-34b1-4fd4-9334-49518f3047e2 1073741824 Jun 30 16:17:46 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:47 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2cb95c40-34b1-4fd4-9334-49518f3047e2 1073741824" returned: 0 in 0.966s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2cb95c40-34b1-4fd4-9334-49518f3047e2 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:47 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2cb95c40-34b1-4fd4-9334-49518f3047e2 Jun 30 16:17:47 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:48 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2cb95c40-34b1-4fd4-9334-49518f3047e2" returned: 0 in 0.657s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:48 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:17:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf9ce5d-cd78-4a22-936f-edc42814fda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cb95c40-34b1-4fd4-9334-49518f3047e2', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30268357-94a8-4539-a0b6-add31e6a0f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:48 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Volume volume-2cb95c40-34b1-4fd4-9334-49518f3047e2 (2cb95c40-34b1-4fd4-9334-49518f3047e2): created successfully Jun 30 16:17:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30268357-94a8-4539-a0b6-add31e6a0f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Flow 'volume_create_manager' (d4830958-cb07-4327-8251-4388cd1d6dc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:17:48 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-5b4f7b54-086c-40be-b5a5-e4ecb9e7732f tempest-VolumeTypesAccessTest-1579016763 None] Created volume successfully. Jun 30 16:17:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6d1397fc-8f2b-4f87-9711-bd2771c72f7b tempest-VolumeTypesAccessTest-1579016763 None] Acquiring lock "cinder-2cb95c40-34b1-4fd4-9334-49518f3047e2-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6d1397fc-8f2b-4f87-9711-bd2771c72f7b tempest-VolumeTypesAccessTest-1579016763 None] Lock "cinder-2cb95c40-34b1-4fd4-9334-49518f3047e2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6d1397fc-8f2b-4f87-9711-bd2771c72f7b tempest-VolumeTypesAccessTest-1579016763 None] Acquiring lock "cinder-quobyte-2cb95c40-34b1-4fd4-9334-49518f3047e2" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:17:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6d1397fc-8f2b-4f87-9711-bd2771c72f7b tempest-VolumeTypesAccessTest-1579016763 None] Lock "cinder-quobyte-2cb95c40-34b1-4fd4-9334-49518f3047e2" acquired by "delete_volume" :: waited 0.014s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:17:48 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5830fb-5f86-4a2a-8f67-43d1cbb2a8bd]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:17:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6d1397fc-8f2b-4f87-9711-bd2771c72f7b tempest-VolumeTypesAccessTest-1579016763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2cb95c40-34b1-4fd4-9334-49518f3047e2 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:48 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2cb95c40-34b1-4fd4-9334-49518f3047e2 Jun 30 16:17:48 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:49 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6d1397fc-8f2b-4f87-9711-bd2771c72f7b tempest-VolumeTypesAccessTest-1579016763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2cb95c40-34b1-4fd4-9334-49518f3047e2" returned: 0 in 0.989s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6d1397fc-8f2b-4f87-9711-bd2771c72f7b tempest-VolumeTypesAccessTest-1579016763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2cb95c40-34b1-4fd4-9334-49518f3047e2 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:49 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2cb95c40-34b1-4fd4-9334-49518f3047e2 Jun 30 16:17:49 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:50 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6d1397fc-8f2b-4f87-9711-bd2771c72f7b tempest-VolumeTypesAccessTest-1579016763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2cb95c40-34b1-4fd4-9334-49518f3047e2" returned: 0 in 0.747s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6d1397fc-8f2b-4f87-9711-bd2771c72f7b tempest-VolumeTypesAccessTest-1579016763 None] Lock "cinder-quobyte-2cb95c40-34b1-4fd4-9334-49518f3047e2" released by "delete_volume" :: held 1.789s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:50 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=105,cinder:INSERT=32,cinder:UPDATE=137,cinder:DELETE=10 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:17:50 devstack cinder-volume[93781]: WARNING cinder.quota [None req-6d1397fc-8f2b-4f87-9711-bd2771c72f7b tempest-VolumeTypesAccessTest-1579016763 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-872847634 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-872847634, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:17:50 devstack cinder-volume[93781]: WARNING cinder.quota [None req-6d1397fc-8f2b-4f87-9711-bd2771c72f7b tempest-VolumeTypesAccessTest-1579016763 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-872847634 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-872847634, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:17:50 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-6d1397fc-8f2b-4f87-9711-bd2771c72f7b tempest-VolumeTypesAccessTest-1579016763 None] Created reservations ['42bceb34-603e-44fe-b875-109571f9e0d1', '5c35d161-92dc-4a78-a839-a4b75cfdd82e', '3d0b8341-e6e0-4169-96dd-d9d3e22b5c90', 'feb63b22-8e59-460b-94f6-d19feff2e318'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:17:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6d1397fc-8f2b-4f87-9711-bd2771c72f7b tempest-VolumeTypesAccessTest-1579016763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6d1397fc-8f2b-4f87-9711-bd2771c72f7b tempest-VolumeTypesAccessTest-1579016763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:50 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6d1397fc-8f2b-4f87-9711-bd2771c72f7b tempest-VolumeTypesAccessTest-1579016763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:17:50 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6d1397fc-8f2b-4f87-9711-bd2771c72f7b tempest-VolumeTypesAccessTest-1579016763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:17:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6d1397fc-8f2b-4f87-9711-bd2771c72f7b tempest-VolumeTypesAccessTest-1579016763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6d1397fc-8f2b-4f87-9711-bd2771c72f7b tempest-VolumeTypesAccessTest-1579016763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:50 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:17:50 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:51 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6d1397fc-8f2b-4f87-9711-bd2771c72f7b tempest-VolumeTypesAccessTest-1579016763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.728s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:51 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-6d1397fc-8f2b-4f87-9711-bd2771c72f7b tempest-VolumeTypesAccessTest-1579016763 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:17:51 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-6d1397fc-8f2b-4f87-9711-bd2771c72f7b tempest-VolumeTypesAccessTest-1579016763 None] Deleted volume successfully. Jun 30 16:17:51 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6d1397fc-8f2b-4f87-9711-bd2771c72f7b tempest-VolumeTypesAccessTest-1579016763 None] Lock "cinder-2cb95c40-34b1-4fd4-9334-49518f3047e2-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:17:55 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:17:55 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Flow 'volume_create_manager' (47c428e3-5817-4398-90bb-5c532e34dab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:17:55 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c86bb8-b28b-4a98-95e8-084aebdfacdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:55 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c86bb8-b28b-4a98-95e8-084aebdfacdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1870757964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f0bece-6041-4937-a6cd-9af40f728a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5c0734705da48f3bafef120b6aeed8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:17:56Z,use_quota=True,user_id='60a196389d58412fa9834d61b5e191f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:55 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61573c0f-f23c-40d3-a2a1-6b4815a186b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:55 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61573c0f-f23c-40d3-a2a1-6b4815a186b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:55 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6136322-1f52-435a-8cd9-4c55a1e1eb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:55 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6136322-1f52-435a-8cd9-4c55a1e1eb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0f0bece-6041-4937-a6cd-9af40f728a8d', 'volume_name': 'volume-f0f0bece-6041-4937-a6cd-9af40f728a8d', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:55 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ada6b85-f4c7-4f87-8a90-9582d0844c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:55 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ada6b85-f4c7-4f87-8a90-9582d0844c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:55 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a45bdb6-2ed3-41b1-b46a-060cc0fd986c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:55 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Volume f0f0bece-6041-4937-a6cd-9af40f728a8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0f0bece-6041-4937-a6cd-9af40f728a8d', 'volume_size': 1} Jun 30 16:17:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:55 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1870757964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f0bece-6041-4937-a6cd-9af40f728a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5c0734705da48f3bafef120b6aeed8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:17:56Z,use_quota=True,user_id='60a196389d58412fa9834d61b5e191f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:17:55 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Creating volume f0f0bece-6041-4937-a6cd-9af40f728a8d {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:17:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:17:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:17:55 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:17:56 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:17:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:56 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:17:56 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:17:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f0f0bece-6041-4937-a6cd-9af40f728a8d 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:56 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f0f0bece-6041-4937-a6cd-9af40f728a8d 1073741824 Jun 30 16:17:56 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:56 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f0f0bece-6041-4937-a6cd-9af40f728a8d 1073741824" returned: 0 in 0.956s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f0f0bece-6041-4937-a6cd-9af40f728a8d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:17:57 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f0f0bece-6041-4937-a6cd-9af40f728a8d Jun 30 16:17:57 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:17:57 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jun 30 16:17:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f0f0bece-6041-4937-a6cd-9af40f728a8d" returned: 0 in 0.706s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:17:57 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:17:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:17:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a45bdb6-2ed3-41b1-b46a-060cc0fd986c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f0bece-6041-4937-a6cd-9af40f728a8d', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b650229-a5a5-4063-98de-fdcb352c14e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:17:57 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Volume volume-f0f0bece-6041-4937-a6cd-9af40f728a8d (f0f0bece-6041-4937-a6cd-9af40f728a8d): created successfully Jun 30 16:17:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b650229-a5a5-4063-98de-fdcb352c14e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:17:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Flow 'volume_create_manager' (47c428e3-5817-4398-90bb-5c532e34dab6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:17:57 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-8dd67ee7-357a-4481-aa80-3b51152276d4 tempest-VolumesTransfersV357Test-716650440 None] Created volume successfully. Jun 30 16:17:58 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-c8f48116-590d-45c4-acfd-1b96beae9ba2 tempest-VolumesTransfersV357Test-1406782470 None] Transfer volume completed successfully. Jun 30 16:18:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8c47ad72-c742-46a0-a029-28751a51eefb tempest-VolumesTransfersV357Test-1165936368 None] Acquiring lock "cinder-f0f0bece-6041-4937-a6cd-9af40f728a8d-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:18:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8c47ad72-c742-46a0-a029-28751a51eefb tempest-VolumesTransfersV357Test-1165936368 None] Lock "cinder-f0f0bece-6041-4937-a6cd-9af40f728a8d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:18:00 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:UPDATE=124,cinder:INSERT=29,cinder:SELECT=95,cinder:DELETE=11 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:18:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8c47ad72-c742-46a0-a029-28751a51eefb tempest-VolumesTransfersV357Test-1165936368 None] Acquiring lock "cinder-quobyte-f0f0bece-6041-4937-a6cd-9af40f728a8d" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:18:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8c47ad72-c742-46a0-a029-28751a51eefb tempest-VolumesTransfersV357Test-1165936368 None] Lock "cinder-quobyte-f0f0bece-6041-4937-a6cd-9af40f728a8d" acquired by "delete_volume" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:18:00 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f41bd38-09ee-4a7e-93c9-ee78a1771e20]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:18:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8c47ad72-c742-46a0-a029-28751a51eefb tempest-VolumesTransfersV357Test-1165936368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f0f0bece-6041-4937-a6cd-9af40f728a8d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:00 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f0f0bece-6041-4937-a6cd-9af40f728a8d Jun 30 16:18:00 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:01 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8c47ad72-c742-46a0-a029-28751a51eefb tempest-VolumesTransfersV357Test-1165936368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f0f0bece-6041-4937-a6cd-9af40f728a8d" returned: 0 in 0.941s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8c47ad72-c742-46a0-a029-28751a51eefb tempest-VolumesTransfersV357Test-1165936368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f0f0bece-6041-4937-a6cd-9af40f728a8d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:01 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f0f0bece-6041-4937-a6cd-9af40f728a8d Jun 30 16:18:01 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:02 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8c47ad72-c742-46a0-a029-28751a51eefb tempest-VolumesTransfersV357Test-1165936368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f0f0bece-6041-4937-a6cd-9af40f728a8d" returned: 0 in 1.022s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:02 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8c47ad72-c742-46a0-a029-28751a51eefb tempest-VolumesTransfersV357Test-1165936368 None] Lock "cinder-quobyte-f0f0bece-6041-4937-a6cd-9af40f728a8d" released by "delete_volume" :: held 2.021s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:18:02 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-8c47ad72-c742-46a0-a029-28751a51eefb tempest-VolumesTransfersV357Test-1165936368 None] Created reservations ['40574e84-e7a0-44ff-aa3d-43d59601bec0', '764fff3a-f45e-4462-890d-d5378d5c6e5c', '99bb0d73-a09d-4911-8274-a183b4d364f0', 'ba5524c3-9752-406f-90ba-784751171575'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:18:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8c47ad72-c742-46a0-a029-28751a51eefb tempest-VolumesTransfersV357Test-1165936368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8c47ad72-c742-46a0-a029-28751a51eefb tempest-VolumesTransfersV357Test-1165936368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-8c47ad72-c742-46a0-a029-28751a51eefb tempest-VolumesTransfersV357Test-1165936368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:18:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-8c47ad72-c742-46a0-a029-28751a51eefb tempest-VolumesTransfersV357Test-1165936368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:18:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8c47ad72-c742-46a0-a029-28751a51eefb tempest-VolumesTransfersV357Test-1165936368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8c47ad72-c742-46a0-a029-28751a51eefb tempest-VolumesTransfersV357Test-1165936368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:02 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:18:02 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Flow 'volume_create_manager' (70b92c54-0d07-4365-b485-c1618c0d17eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667eb1d6-e801-4c30-b3b2-b457f75142e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (667eb1d6-e801-4c30-b3b2-b457f75142e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-12949438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac36e01d-6066-4e3d-8d22-e7bd967b656a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5c0734705da48f3bafef120b6aeed8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:18:03Z,use_quota=True,user_id='60a196389d58412fa9834d61b5e191f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ed4ef7-a604-4b93-9c10-5791be805125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ed4ef7-a604-4b93-9c10-5791be805125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f27de76-0be6-4ecf-952a-449fe7f203c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f27de76-0be6-4ecf-952a-449fe7f203c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac36e01d-6066-4e3d-8d22-e7bd967b656a', 'volume_name': 'volume-ac36e01d-6066-4e3d-8d22-e7bd967b656a', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55163623-4f82-4b63-b2c9-f1b94ca0fd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55163623-4f82-4b63-b2c9-f1b94ca0fd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da77a24-a253-400d-9985-c11caba0a55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:03 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Volume ac36e01d-6066-4e3d-8d22-e7bd967b656a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac36e01d-6066-4e3d-8d22-e7bd967b656a', 'volume_size': 1} Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-12949438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac36e01d-6066-4e3d-8d22-e7bd967b656a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5c0734705da48f3bafef120b6aeed8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:18:03Z,use_quota=True,user_id='60a196389d58412fa9834d61b5e191f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Creating volume ac36e01d-6066-4e3d-8d22-e7bd967b656a {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:18:03 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ac36e01d-6066-4e3d-8d22-e7bd967b656a 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:03 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8c47ad72-c742-46a0-a029-28751a51eefb tempest-VolumesTransfersV357Test-1165936368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.864s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-8c47ad72-c742-46a0-a029-28751a51eefb tempest-VolumesTransfersV357Test-1165936368 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:18:03 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-8c47ad72-c742-46a0-a029-28751a51eefb tempest-VolumesTransfersV357Test-1165936368 None] Deleted volume successfully. Jun 30 16:18:03 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ac36e01d-6066-4e3d-8d22-e7bd967b656a 1073741824 Jun 30 16:18:03 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:03 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8c47ad72-c742-46a0-a029-28751a51eefb tempest-VolumesTransfersV357Test-1165936368 None] Lock "cinder-f0f0bece-6041-4937-a6cd-9af40f728a8d-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:18:04 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ac36e01d-6066-4e3d-8d22-e7bd967b656a 1073741824" returned: 0 in 1.115s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ac36e01d-6066-4e3d-8d22-e7bd967b656a {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:04 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ac36e01d-6066-4e3d-8d22-e7bd967b656a Jun 30 16:18:04 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:05 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ac36e01d-6066-4e3d-8d22-e7bd967b656a" returned: 0 in 0.759s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:05 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] <== create_volume: return (1945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:18:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.948s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:05 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da77a24-a253-400d-9985-c11caba0a55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac36e01d-6066-4e3d-8d22-e7bd967b656a', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:05 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246cb512-72c4-4de7-aa47-e14045b27ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:05 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Volume volume-ac36e01d-6066-4e3d-8d22-e7bd967b656a (ac36e01d-6066-4e3d-8d22-e7bd967b656a): created successfully Jun 30 16:18:05 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246cb512-72c4-4de7-aa47-e14045b27ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:05 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Flow 'volume_create_manager' (70b92c54-0d07-4365-b485-c1618c0d17eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:18:05 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-c4f0a5df-9681-40ce-8873-a7b9d7e8a33c tempest-VolumesTransfersV357Test-716650440 None] Created volume successfully. Jun 30 16:18:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d5aa037c-380b-4584-bc5a-05261e2ca037 tempest-VolumesTransfersV357Test-1165936368 None] Acquiring lock "cinder-ac36e01d-6066-4e3d-8d22-e7bd967b656a-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:18:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d5aa037c-380b-4584-bc5a-05261e2ca037 tempest-VolumesTransfersV357Test-1165936368 None] Lock "cinder-ac36e01d-6066-4e3d-8d22-e7bd967b656a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:18:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d5aa037c-380b-4584-bc5a-05261e2ca037 tempest-VolumesTransfersV357Test-1165936368 None] Acquiring lock "cinder-quobyte-ac36e01d-6066-4e3d-8d22-e7bd967b656a" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:18:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d5aa037c-380b-4584-bc5a-05261e2ca037 tempest-VolumesTransfersV357Test-1165936368 None] Lock "cinder-quobyte-ac36e01d-6066-4e3d-8d22-e7bd967b656a" acquired by "delete_volume" :: waited 0.021s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:18:06 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54dd9fe-f0e5-4507-b69b-8f0a3883773a]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:18:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d5aa037c-380b-4584-bc5a-05261e2ca037 tempest-VolumesTransfersV357Test-1165936368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ac36e01d-6066-4e3d-8d22-e7bd967b656a {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:06 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ac36e01d-6066-4e3d-8d22-e7bd967b656a Jun 30 16:18:06 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:07 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d5aa037c-380b-4584-bc5a-05261e2ca037 tempest-VolumesTransfersV357Test-1165936368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ac36e01d-6066-4e3d-8d22-e7bd967b656a" returned: 0 in 0.947s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d5aa037c-380b-4584-bc5a-05261e2ca037 tempest-VolumesTransfersV357Test-1165936368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ac36e01d-6066-4e3d-8d22-e7bd967b656a {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:07 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ac36e01d-6066-4e3d-8d22-e7bd967b656a Jun 30 16:18:07 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:08 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d5aa037c-380b-4584-bc5a-05261e2ca037 tempest-VolumesTransfersV357Test-1165936368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ac36e01d-6066-4e3d-8d22-e7bd967b656a" returned: 0 in 0.739s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:08 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d5aa037c-380b-4584-bc5a-05261e2ca037 tempest-VolumesTransfersV357Test-1165936368 None] Lock "cinder-quobyte-ac36e01d-6066-4e3d-8d22-e7bd967b656a" released by "delete_volume" :: held 1.728s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:18:08 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-d5aa037c-380b-4584-bc5a-05261e2ca037 tempest-VolumesTransfersV357Test-1165936368 None] Created reservations ['6ce47c9c-2b2f-42ac-ab3c-a60379d64213', '279d4504-c777-4c62-a174-b25d7be10381', 'b5ca7d7d-8a80-4e16-b354-1c2f008615bd', 'a7ee8115-8da5-4c48-903c-64904908873f'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:18:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d5aa037c-380b-4584-bc5a-05261e2ca037 tempest-VolumesTransfersV357Test-1165936368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d5aa037c-380b-4584-bc5a-05261e2ca037 tempest-VolumesTransfersV357Test-1165936368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d5aa037c-380b-4584-bc5a-05261e2ca037 tempest-VolumesTransfersV357Test-1165936368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:18:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d5aa037c-380b-4584-bc5a-05261e2ca037 tempest-VolumesTransfersV357Test-1165936368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:18:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d5aa037c-380b-4584-bc5a-05261e2ca037 tempest-VolumesTransfersV357Test-1165936368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d5aa037c-380b-4584-bc5a-05261e2ca037 tempest-VolumesTransfersV357Test-1165936368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:08 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:18:08 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:09 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d5aa037c-380b-4584-bc5a-05261e2ca037 tempest-VolumesTransfersV357Test-1165936368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.820s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:09 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-d5aa037c-380b-4584-bc5a-05261e2ca037 tempest-VolumesTransfersV357Test-1165936368 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:18:09 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-d5aa037c-380b-4584-bc5a-05261e2ca037 tempest-VolumesTransfersV357Test-1165936368 None] Deleted volume successfully. Jun 30 16:18:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d5aa037c-380b-4584-bc5a-05261e2ca037 tempest-VolumesTransfersV357Test-1165936368 None] Lock "cinder-ac36e01d-6066-4e3d-8d22-e7bd967b656a-delete_volume" released by "delete_volume" :: held 2.843s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:18:10 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:18:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Flow 'volume_create_manager' (348d443b-7a39-4071-abc6-015d8cb186ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:18:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0dee05-41e3-473a-be00-06eabd4bfe61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0dee05-41e3-473a-be00-06eabd4bfe61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1621588232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd30e56b-8a79-4682-a919-6cfef2bedbf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f856b4f50724c01836233f1c792f733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:18:11Z,use_quota=True,user_id='5422511325124a93836c28df20a004b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be72c209-eb7c-406a-86ae-9275a2c30f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be72c209-eb7c-406a-86ae-9275a2c30f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be409b18-c978-4087-ab07-f8a94a874808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be409b18-c978-4087-ab07-f8a94a874808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd30e56b-8a79-4682-a919-6cfef2bedbf5', 'volume_name': 'volume-bd30e56b-8a79-4682-a919-6cfef2bedbf5', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7765e9-4869-4528-8319-814916b5daed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:11 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7765e9-4869-4528-8319-814916b5daed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:11 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678aa72c-d5ff-4377-8632-52c83d063f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:11 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Volume bd30e56b-8a79-4682-a919-6cfef2bedbf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd30e56b-8a79-4682-a919-6cfef2bedbf5', 'volume_size': 1} Jun 30 16:18:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:11 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1621588232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd30e56b-8a79-4682-a919-6cfef2bedbf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f856b4f50724c01836233f1c792f733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:18:11Z,use_quota=True,user_id='5422511325124a93836c28df20a004b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:18:11 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Creating volume bd30e56b-8a79-4682-a919-6cfef2bedbf5 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:18:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:11 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:18:11 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:18:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:11 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:18:11 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:18:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bd30e56b-8a79-4682-a919-6cfef2bedbf5 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:11 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bd30e56b-8a79-4682-a919-6cfef2bedbf5 1073741824 Jun 30 16:18:11 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:11 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bd30e56b-8a79-4682-a919-6cfef2bedbf5 1073741824" returned: 0 in 0.981s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bd30e56b-8a79-4682-a919-6cfef2bedbf5 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:12 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bd30e56b-8a79-4682-a919-6cfef2bedbf5 Jun 30 16:18:12 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:12 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bd30e56b-8a79-4682-a919-6cfef2bedbf5" returned: 0 in 0.723s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:12 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:18:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:12 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678aa72c-d5ff-4377-8632-52c83d063f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd30e56b-8a79-4682-a919-6cfef2bedbf5', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:12 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3655433a-6e01-4c4a-8124-7319593a9188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:12 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Volume volume-bd30e56b-8a79-4682-a919-6cfef2bedbf5 (bd30e56b-8a79-4682-a919-6cfef2bedbf5): created successfully Jun 30 16:18:12 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3655433a-6e01-4c4a-8124-7319593a9188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:12 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Flow 'volume_create_manager' (348d443b-7a39-4071-abc6-015d8cb186ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:18:12 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-6f2e1625-eed8-4ca2-af60-cd78da9cdb46 tempest-VolumesListAdminTestJSON-265112830 None] Created volume successfully. Jun 30 16:18:13 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:18:13 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Flow 'volume_create_manager' (88d917a4-6a93-4b05-aff9-5c4457b2d233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:18:13 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57289085-652d-4dd0-9ea2-d0beea006b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:13 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57289085-652d-4dd0-9ea2-d0beea006b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1944467178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a145911d-2621-4240-bc82-4cd4cf05567f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f856b4f50724c01836233f1c792f733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:18:14Z,use_quota=True,user_id='5422511325124a93836c28df20a004b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:13 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df45206f-53ef-4977-a168-6d7a721806bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:13 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df45206f-53ef-4977-a168-6d7a721806bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:13 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbac9075-692c-482b-86e5-c4d5fc1c4307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:13 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbac9075-692c-482b-86e5-c4d5fc1c4307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a145911d-2621-4240-bc82-4cd4cf05567f', 'volume_name': 'volume-a145911d-2621-4240-bc82-4cd4cf05567f', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:13 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00eeb26b-9865-41f6-bba0-a71f1662b7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:13 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00eeb26b-9865-41f6-bba0-a71f1662b7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:13 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c85efb-c299-4e98-bfac-ecee8ff38321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:13 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Volume a145911d-2621-4240-bc82-4cd4cf05567f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a145911d-2621-4240-bc82-4cd4cf05567f', 'volume_size': 1} Jun 30 16:18:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:13 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1944467178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a145911d-2621-4240-bc82-4cd4cf05567f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f856b4f50724c01836233f1c792f733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:18:14Z,use_quota=True,user_id='5422511325124a93836c28df20a004b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:18:13 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Creating volume a145911d-2621-4240-bc82-4cd4cf05567f {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:18:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:13 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:18:13 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:18:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:13 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:18:13 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:18:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a145911d-2621-4240-bc82-4cd4cf05567f 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:13 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a145911d-2621-4240-bc82-4cd4cf05567f 1073741824 Jun 30 16:18:13 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:14 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a145911d-2621-4240-bc82-4cd4cf05567f 1073741824" returned: 0 in 0.884s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a145911d-2621-4240-bc82-4cd4cf05567f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:14 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a145911d-2621-4240-bc82-4cd4cf05567f Jun 30 16:18:14 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Flow 'volume_create_manager' (9373e36b-ce69-4f97-97ba-2645f87e5520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf4b401-8b4b-4a9a-8278-bf2bf4739862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf4b401-8b4b-4a9a-8278-bf2bf4739862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1629811680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707466b9-4a08-446e-ad57-a0b434ba5caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890c40fa0c464d19845a7bad26588bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:18:15Z,use_quota=True,user_id='d73a05e5ec26488995d34eb09b46d1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09fcb83-72ce-4f41-9610-7fad8879784d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09fcb83-72ce-4f41-9610-7fad8879784d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f163251-6cb7-4e2d-b661-d4f9df1da53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f163251-6cb7-4e2d-b661-d4f9df1da53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '707466b9-4a08-446e-ad57-a0b434ba5caf', 'volume_name': 'volume-707466b9-4a08-446e-ad57-a0b434ba5caf', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7890778f-ff21-4aa7-90e4-d2b6f0d787cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7890778f-ff21-4aa7-90e4-d2b6f0d787cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe0c285-4e92-415a-8594-08aa47c8f112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:15 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Volume 707466b9-4a08-446e-ad57-a0b434ba5caf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-707466b9-4a08-446e-ad57-a0b434ba5caf', 'volume_size': 1} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:15 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a145911d-2621-4240-bc82-4cd4cf05567f" returned: 0 in 0.692s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.152s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1629811680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707466b9-4a08-446e-ad57-a0b434ba5caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890c40fa0c464d19845a7bad26588bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:18:15Z,use_quota=True,user_id='d73a05e5ec26488995d34eb09b46d1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Creating volume 707466b9-4a08-446e-ad57-a0b434ba5caf {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:18:15 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c85efb-c299-4e98-bfac-ecee8ff38321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a145911d-2621-4240-bc82-4cd4cf05567f', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:15 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf 1073741824 Jun 30 16:18:15 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f105d97-b363-4d9e-ac49-dba95f651676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:15 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Volume volume-a145911d-2621-4240-bc82-4cd4cf05567f (a145911d-2621-4240-bc82-4cd4cf05567f): created successfully Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f105d97-b363-4d9e-ac49-dba95f651676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Flow 'volume_create_manager' (88d917a4-6a93-4b05-aff9-5c4457b2d233) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:18:15 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-d9385df7-f6d2-4fa1-9007-fe1ae39cb6ec tempest-VolumesListAdminTestJSON-265112830 None] Created volume successfully. Jun 30 16:18:16 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:16 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:18:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Flow 'volume_create_manager' (3e28cd7d-d27b-4c33-a549-0b63a8b8da98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:18:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed55d5cb-ca7d-46f9-8dc6-bd76df0a75c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf 1073741824" returned: 0 in 0.946s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed55d5cb-ca7d-46f9-8dc6-bd76df0a75c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-124310234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0d23fff-a491-40d1-9519-345e2948893b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f856b4f50724c01836233f1c792f733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:18:16Z,use_quota=True,user_id='5422511325124a93836c28df20a004b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93fd934-217d-437c-aa26-170a71a0e6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93fd934-217d-437c-aa26-170a71a0e6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549590ad-9521-4269-9509-a1627e229c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549590ad-9521-4269-9509-a1627e229c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0d23fff-a491-40d1-9519-345e2948893b', 'volume_name': 'volume-a0d23fff-a491-40d1-9519-345e2948893b', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd327bf-9047-46e4-b29c-67033a291d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd327bf-9047-46e4-b29c-67033a291d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee159c3-4a48-4636-8f48-e2c3d4561244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:16 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Volume a0d23fff-a491-40d1-9519-345e2948893b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0d23fff-a491-40d1-9519-345e2948893b', 'volume_size': 1} Jun 30 16:18:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:16 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf Jun 30 16:18:16 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:17 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf" returned: 0 in 0.621s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.647s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-124310234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0d23fff-a491-40d1-9519-345e2948893b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f856b4f50724c01836233f1c792f733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:18:16Z,use_quota=True,user_id='5422511325124a93836c28df20a004b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Creating volume a0d23fff-a491-40d1-9519-345e2948893b {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:18:17 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a0d23fff-a491-40d1-9519-345e2948893b 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe0c285-4e92-415a-8594-08aa47c8f112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-707466b9-4a08-446e-ad57-a0b434ba5caf', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:17 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a0d23fff-a491-40d1-9519-345e2948893b 1073741824 Jun 30 16:18:17 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9d4f9f-4c57-4a8c-8e29-66473c01cb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:17 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Volume volume-707466b9-4a08-446e-ad57-a0b434ba5caf (707466b9-4a08-446e-ad57-a0b434ba5caf): created successfully Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9d4f9f-4c57-4a8c-8e29-66473c01cb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Flow 'volume_create_manager' (9373e36b-ce69-4f97-97ba-2645f87e5520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:18:17 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-69b22d6a-ad71-40f6-8515-e153a490586d tempest-VolumesCloneTest-1915872653 None] Created volume successfully. Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Flow 'volume_create_manager' (dfe5dd4f-0d88-423f-9605-9e5b014ec435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (259d1257-f6e3-42b7-b0f7-f4dd8670a7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (259d1257-f6e3-42b7-b0f7-f4dd8670a7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-55692652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c0d6b2-00c2-4531-8393-aed9e55405a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890c40fa0c464d19845a7bad26588bc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:18:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=707466b9-4a08-446e-ad57-a0b434ba5caf,status='creating',terminated_at=None,updated_at=2026-06-30T14:18:18Z,use_quota=True,user_id='d73a05e5ec26488995d34eb09b46d1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb569f81-162d-4ec5-b2f7-77e6f1109ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb569f81-162d-4ec5-b2f7-77e6f1109ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815caa4b-0342-4d2d-b4d2-d865e159cc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815caa4b-0342-4d2d-b4d2-d865e159cc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a2c0d6b2-00c2-4531-8393-aed9e55405a7', 'volume_name': 'volume-a2c0d6b2-00c2-4531-8393-aed9e55405a7', 'volume_size': 2, 'source_volid': '707466b9-4a08-446e-ad57-a0b434ba5caf', 'source_volstatus': 'available'}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b5ddf4-6643-44b5-a967-451a05738f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b5ddf4-6643-44b5-a967-451a05738f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc3ff79-74d7-4b5e-bf3d-c0a78c73e97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:17 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Volume a2c0d6b2-00c2-4531-8393-aed9e55405a7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a2c0d6b2-00c2-4531-8393-aed9e55405a7', 'volume_size': 2, 'source_volid': '707466b9-4a08-446e-ad57-a0b434ba5caf', 'source_volstatus': 'available'} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:17 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a0d23fff-a491-40d1-9519-345e2948893b 1073741824" returned: 0 in 0.879s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a0d23fff-a491-40d1-9519-345e2948893b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:17 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a0d23fff-a491-40d1-9519-345e2948893b Jun 30 16:18:17 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:18 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a0d23fff-a491-40d1-9519-345e2948893b" returned: 0 in 0.630s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:18 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:18:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.699s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:18 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Cloning volume 707466b9-4a08-446e-ad57-a0b434ba5caf to volume a2c0d6b2-00c2-4531-8393-aed9e55405a7 Jun 30 16:18:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee159c3-4a48-4636-8f48-e2c3d4561244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0d23fff-a491-40d1-9519-345e2948893b', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53ebda1-abb3-441c-bfe3-cdba52094a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:18 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Volume volume-a0d23fff-a491-40d1-9519-345e2948893b (a0d23fff-a491-40d1-9519-345e2948893b): created successfully Jun 30 16:18:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53ebda1-abb3-441c-bfe3-cdba52094a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Flow 'volume_create_manager' (3e28cd7d-d27b-4c33-a549-0b63a8b8da98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:18:18 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Creating offline snapshot 99dc480a-ce55-4704-9fc2-2bb554575025 of volume 707466b9-4a08-446e-ad57-a0b434ba5caf {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:18:18 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-2b321f52-d1bd-4462-b693-fd3ae04a0bd5 tempest-VolumesListAdminTestJSON-265112830 None] Created volume successfully. Jun 30 16:18:18 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ddfe91-46e4-44c8-ae1a-443a8da5fce7]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:18:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:18 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf Jun 30 16:18:18 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:19 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf" returned: 0 in 0.818s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.99dc480a-ce55-4704-9fc2-2bb554575025 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:19 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.99dc480a-ce55-4704-9fc2-2bb554575025 1G Jun 30 16:18:19 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:20 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:18:20 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Flow 'volume_create_manager' (dbd16690-6b7c-4270-8665-0bd3f3abd60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:18:20 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c5b172-ae3d-4813-8994-b2a726e0d1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:20 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c5b172-ae3d-4813-8994-b2a726e0d1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7325baca-3f35-4b6c-9576-5d1f935627f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00bf9ce36a30476bb25a21ed4cc6e7a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:18:20Z,use_quota=True,user_id='c7c6a52f2b18445e9c086da6d8636959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:20 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487535b1-0d87-4d0c-bba7-463437b842e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:20 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487535b1-0d87-4d0c-bba7-463437b842e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:20 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572ae42f-7b70-4b52-95a0-643f6ee92283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:20 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572ae42f-7b70-4b52-95a0-643f6ee92283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7325baca-3f35-4b6c-9576-5d1f935627f0', 'volume_name': 'volume-7325baca-3f35-4b6c-9576-5d1f935627f0', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:20 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e04df3-6528-47c7-9b36-a299ed0fd3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:20 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e04df3-6528-47c7-9b36-a299ed0fd3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:20 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b972a34-f667-4f10-b6b6-48c57a1e4987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:20 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Volume 7325baca-3f35-4b6c-9576-5d1f935627f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7325baca-3f35-4b6c-9576-5d1f935627f0', 'volume_size': 1} Jun 30 16:18:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:20 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.99dc480a-ce55-4704-9fc2-2bb554575025 1G" returned: 0 in 0.881s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-707466b9-4a08-446e-ad57-a0b434ba5caf -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.99dc480a-ce55-4704-9fc2-2bb554575025 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:20 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-707466b9-4a08-446e-ad57-a0b434ba5caf -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.99dc480a-ce55-4704-9fc2-2bb554575025 Jun 30 16:18:20 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:21 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-707466b9-4a08-446e-ad57-a0b434ba5caf -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.99dc480a-ce55-4704-9fc2-2bb554575025" returned: 0 in 0.699s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:21 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.99dc480a-ce55-4704-9fc2-2bb554575025 is being set with open permissions: ugo+rw Jun 30 16:18:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.99dc480a-ce55-4704-9fc2-2bb554575025 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:21 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.99dc480a-ce55-4704-9fc2-2bb554575025 Jun 30 16:18:21 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:21 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.99dc480a-ce55-4704-9fc2-2bb554575025" returned: 0 in 0.655s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:21 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.info Jun 30 16:18:21 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:22 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.info" returned: 0 in 0.661s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:22 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.info is being set with open permissions: ugo+rw Jun 30 16:18:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:22 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.info Jun 30 16:18:22 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:23 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.info" returned: 0 in 0.665s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Acquiring lock "cinder-quobyte-a2c0d6b2-00c2-4531-8393-aed9e55405a7" by "_copy_volume_from_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:18:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Lock "cinder-quobyte-a2c0d6b2-00c2-4531-8393-aed9e55405a7" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:18:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] snapshot: 99dc480a-ce55-4704-9fc2-2bb554575025, volume: a2c0d6b2-00c2-4531-8393-aed9e55405a7, {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 30 16:18:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:18:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:18:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:23 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[291b2e2a-5331-42a0-9a69-0a50c2019ea3]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:18:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.99dc480a-ce55-4704-9fc2-2bb554575025 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:23 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.99dc480a-ce55-4704-9fc2-2bb554575025 Jun 30 16:18:23 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:23 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.99dc480a-ce55-4704-9fc2-2bb554575025" returned: 0 in 0.752s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-707466b9-4a08-446e-ad57-a0b434ba5caf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:18:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] will copy from snapshot at /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 30 16:18:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Creating direct copy from snapshot {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 30 16:18:23 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52930e1-623e-45c5-9453-5e74a9ef6ed5]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:18:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:24 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf Jun 30 16:18:24 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:24 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf" returned: 0 in 0.790s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:24 devstack cinder-volume[93781]: DEBUG cinder.utils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Path /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a2c0d6b2-00c2-4531-8393-aed9e55405a7 not found in is_blk_device check {{(pid=93781) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 30 16:18:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a2c0d6b2-00c2-4531-8393-aed9e55405a7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:24 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a2c0d6b2-00c2-4531-8393-aed9e55405a7 Jun 30 16:18:24 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:29 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a2c0d6b2-00c2-4531-8393-aed9e55405a7" returned: 0 in 4.763s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:29 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58f508d-e36a-438c-87c8-ae4b624acb84]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:18:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:29 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf Jun 30 16:18:29 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:30 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf" returned: 0 in 0.982s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:30 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Image conversion details: src /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf, size 1024.00 MB, duration 4.76 sec, destination /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a2c0d6b2-00c2-4531-8393-aed9e55405a7 {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:18:30 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Converted 1024.00 MB image at 214.93 MB/s Jun 30 16:18:30 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a2c0d6b2-00c2-4531-8393-aed9e55405a7 is being set with open permissions: ugo+rw Jun 30 16:18:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a2c0d6b2-00c2-4531-8393-aed9e55405a7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:30 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a2c0d6b2-00c2-4531-8393-aed9e55405a7 Jun 30 16:18:30 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:31 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a2c0d6b2-00c2-4531-8393-aed9e55405a7" returned: 0 in 0.659s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:31 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Lock "cinder-quobyte-a2c0d6b2-00c2-4531-8393-aed9e55405a7" released by "_copy_volume_from_snapshot" :: held 8.032s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:18:31 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Acquiring lock "cinder-quobyte-99dc480a-ce55-4704-9fc2-2bb554575025" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:18:31 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Lock "cinder-quobyte-99dc480a-ce55-4704-9fc2-2bb554575025" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:18:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Deleting offline snapshot 99dc480a-ce55-4704-9fc2-2bb554575025 of volume 707466b9-4a08-446e-ad57-a0b434ba5caf {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:18:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] snapshot_file for this snap is: volume-707466b9-4a08-446e-ad57-a0b434ba5caf.99dc480a-ce55-4704-9fc2-2bb554575025 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:18:31 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a79cfa-4fe2-4dad-bf64-7a1e16e87f57]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:18:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.99dc480a-ce55-4704-9fc2-2bb554575025 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:31 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.99dc480a-ce55-4704-9fc2-2bb554575025 Jun 30 16:18:31 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:31 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:UPDATE=48,cinder:SELECT=28,cinder:DELETE=3,cinder:INSERT=7 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:18:31 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.99dc480a-ce55-4704-9fc2-2bb554575025" returned: 0 in 0.795s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-707466b9-4a08-446e-ad57-a0b434ba5caf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:18:32 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30fecee-ddf0-4813-bc06-224377757956]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:18:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:32 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf Jun 30 16:18:32 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:32 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf" returned: 0 in 0.795s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.99dc480a-ce55-4704-9fc2-2bb554575025 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:32 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.99dc480a-ce55-4704-9fc2-2bb554575025 Jun 30 16:18:32 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:18:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:18:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:18:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:33 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:18:33 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:33 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.99dc480a-ce55-4704-9fc2-2bb554575025" returned: 0 in 0.794s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.99dc480a-ce55-4704-9fc2-2bb554575025 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:33 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.99dc480a-ce55-4704-9fc2-2bb554575025 Jun 30 16:18:33 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:33 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.689s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:33 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:18:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:18:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 28 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:18:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:18:34 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf.99dc480a-ce55-4704-9fc2-2bb554575025" returned: 0 in 0.693s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:34 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Lock "cinder-quobyte-99dc480a-ce55-4704-9fc2-2bb554575025" released by "_delete_snapshot" :: held 3.162s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:18:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.787s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.082s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7325baca-3f35-4b6c-9576-5d1f935627f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00bf9ce36a30476bb25a21ed4cc6e7a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:18:20Z,use_quota=True,user_id='c7c6a52f2b18445e9c086da6d8636959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:18:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Creating volume 7325baca-3f35-4b6c-9576-5d1f935627f0 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:18:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:18:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:18:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:18:34 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:18:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7325baca-3f35-4b6c-9576-5d1f935627f0 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc3ff79-74d7-4b5e-bf3d-c0a78c73e97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2c0d6b2-00c2-4531-8393-aed9e55405a7', 'volume_size': 2, 'source_volid': '707466b9-4a08-446e-ad57-a0b434ba5caf', 'source_volstatus': 'available'}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:34 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7325baca-3f35-4b6c-9576-5d1f935627f0 1073741824 Jun 30 16:18:34 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14d3750-d908-487a-97a1-680a80068972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:34 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Volume volume-a2c0d6b2-00c2-4531-8393-aed9e55405a7 (a2c0d6b2-00c2-4531-8393-aed9e55405a7): created successfully Jun 30 16:18:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14d3750-d908-487a-97a1-680a80068972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Flow 'volume_create_manager' (dfe5dd4f-0d88-423f-9605-9e5b014ec435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:18:34 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-88970f16-b3dc-40b6-8599-6f4fd8dd56bc tempest-VolumesCloneTest-1915872653 None] Created volume successfully. Jun 30 16:18:35 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b6ca1718-c834-4b40-b285-824e0c881146 tempest-VolumesCloneTest-1915872653 None] Acquiring lock "cinder-a2c0d6b2-00c2-4531-8393-aed9e55405a7-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:18:35 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b6ca1718-c834-4b40-b285-824e0c881146 tempest-VolumesCloneTest-1915872653 None] Lock "cinder-a2c0d6b2-00c2-4531-8393-aed9e55405a7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:18:35 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b6ca1718-c834-4b40-b285-824e0c881146 tempest-VolumesCloneTest-1915872653 None] Acquiring lock "cinder-quobyte-a2c0d6b2-00c2-4531-8393-aed9e55405a7" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:18:35 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b6ca1718-c834-4b40-b285-824e0c881146 tempest-VolumesCloneTest-1915872653 None] Lock "cinder-quobyte-a2c0d6b2-00c2-4531-8393-aed9e55405a7" acquired by "delete_volume" :: waited 0.024s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:18:35 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30c138b-e5ea-4b0d-be8d-6138f728b7f1]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:18:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b6ca1718-c834-4b40-b285-824e0c881146 tempest-VolumesCloneTest-1915872653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a2c0d6b2-00c2-4531-8393-aed9e55405a7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:35 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a2c0d6b2-00c2-4531-8393-aed9e55405a7 Jun 30 16:18:35 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:35 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7325baca-3f35-4b6c-9576-5d1f935627f0 1073741824" returned: 0 in 0.975s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7325baca-3f35-4b6c-9576-5d1f935627f0 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:35 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7325baca-3f35-4b6c-9576-5d1f935627f0 Jun 30 16:18:35 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:36 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b6ca1718-c834-4b40-b285-824e0c881146 tempest-VolumesCloneTest-1915872653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a2c0d6b2-00c2-4531-8393-aed9e55405a7" returned: 0 in 0.815s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b6ca1718-c834-4b40-b285-824e0c881146 tempest-VolumesCloneTest-1915872653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a2c0d6b2-00c2-4531-8393-aed9e55405a7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:36 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a2c0d6b2-00c2-4531-8393-aed9e55405a7 Jun 30 16:18:36 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:36 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7325baca-3f35-4b6c-9576-5d1f935627f0" returned: 0 in 0.717s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b972a34-f667-4f10-b6b6-48c57a1e4987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7325baca-3f35-4b6c-9576-5d1f935627f0', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cba2c195-9721-49ca-916a-32bc6b8a1f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:36 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Volume volume-7325baca-3f35-4b6c-9576-5d1f935627f0 (7325baca-3f35-4b6c-9576-5d1f935627f0): created successfully Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cba2c195-9721-49ca-916a-32bc6b8a1f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Flow 'volume_create_manager' (dbd16690-6b7c-4270-8665-0bd3f3abd60d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:18:36 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-72296716-4a6e-4db1-ba54-740cfa1e2460 tempest-VolumesListAdminTestJSON-1979367101 None] Created volume successfully. Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5402b7ae-05c3-40fe-a11b-d2b5004d4f8a tempest-VolumesListAdminTestJSON-1979367101 None] Acquiring lock "cinder-7325baca-3f35-4b6c-9576-5d1f935627f0-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5402b7ae-05c3-40fe-a11b-d2b5004d4f8a tempest-VolumesListAdminTestJSON-1979367101 None] Lock "cinder-7325baca-3f35-4b6c-9576-5d1f935627f0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5402b7ae-05c3-40fe-a11b-d2b5004d4f8a tempest-VolumesListAdminTestJSON-1979367101 None] Acquiring lock "cinder-quobyte-7325baca-3f35-4b6c-9576-5d1f935627f0" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5402b7ae-05c3-40fe-a11b-d2b5004d4f8a tempest-VolumesListAdminTestJSON-1979367101 None] Lock "cinder-quobyte-7325baca-3f35-4b6c-9576-5d1f935627f0" acquired by "delete_volume" :: waited 0.023s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[792b3d22-b75e-4e2e-9596-9cef06a77ed0]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5402b7ae-05c3-40fe-a11b-d2b5004d4f8a tempest-VolumesListAdminTestJSON-1979367101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7325baca-3f35-4b6c-9576-5d1f935627f0 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b096f7d8-32fc-416c-84fc-92d359ff48a4 tempest-VolumesListAdminTestJSON-265112830 None] Acquiring lock "cinder-a0d23fff-a491-40d1-9519-345e2948893b-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b096f7d8-32fc-416c-84fc-92d359ff48a4 tempest-VolumesListAdminTestJSON-265112830 None] Lock "cinder-a0d23fff-a491-40d1-9519-345e2948893b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b096f7d8-32fc-416c-84fc-92d359ff48a4 tempest-VolumesListAdminTestJSON-265112830 None] Acquiring lock "cinder-quobyte-a0d23fff-a491-40d1-9519-345e2948893b" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b096f7d8-32fc-416c-84fc-92d359ff48a4 tempest-VolumesListAdminTestJSON-265112830 None] Lock "cinder-quobyte-a0d23fff-a491-40d1-9519-345e2948893b" acquired by "delete_volume" :: waited 0.019s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:18:36 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7325baca-3f35-4b6c-9576-5d1f935627f0 Jun 30 16:18:36 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd2f6ea-9408-4366-9547-67e2b0d1740f]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b096f7d8-32fc-416c-84fc-92d359ff48a4 tempest-VolumesListAdminTestJSON-265112830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a0d23fff-a491-40d1-9519-345e2948893b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:36 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b6ca1718-c834-4b40-b285-824e0c881146 tempest-VolumesCloneTest-1915872653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a2c0d6b2-00c2-4531-8393-aed9e55405a7" returned: 0 in 0.824s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b6ca1718-c834-4b40-b285-824e0c881146 tempest-VolumesCloneTest-1915872653 None] Lock "cinder-quobyte-a2c0d6b2-00c2-4531-8393-aed9e55405a7" released by "delete_volume" :: held 1.683s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:18:36 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a0d23fff-a491-40d1-9519-345e2948893b Jun 30 16:18:36 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:36 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-b6ca1718-c834-4b40-b285-824e0c881146 tempest-VolumesCloneTest-1915872653 None] Created reservations ['0b1f9f10-a816-40b4-9e4a-5dc4e75e79a5', 'eef60cbd-0afd-441d-a3e0-ba5cca780cfc', '794cfb7e-b0b9-41c8-b637-0b0924d6a0b1', '03ea1601-542a-4d33-bbcf-08f3a0cf05aa'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:18:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b6ca1718-c834-4b40-b285-824e0c881146 tempest-VolumesCloneTest-1915872653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b6ca1718-c834-4b40-b285-824e0c881146 tempest-VolumesCloneTest-1915872653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b6ca1718-c834-4b40-b285-824e0c881146 tempest-VolumesCloneTest-1915872653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:18:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b6ca1718-c834-4b40-b285-824e0c881146 tempest-VolumesCloneTest-1915872653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:18:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b6ca1718-c834-4b40-b285-824e0c881146 tempest-VolumesCloneTest-1915872653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b6ca1718-c834-4b40-b285-824e0c881146 tempest-VolumesCloneTest-1915872653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:37 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:18:37 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:37 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2bfacfd1-e2e9-437c-99a4-d6858c882e4f tempest-VolumesCloneTest-1915872653 None] Acquiring lock "cinder-707466b9-4a08-446e-ad57-a0b434ba5caf-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:18:37 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2bfacfd1-e2e9-437c-99a4-d6858c882e4f tempest-VolumesCloneTest-1915872653 None] Lock "cinder-707466b9-4a08-446e-ad57-a0b434ba5caf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:18:37 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2bfacfd1-e2e9-437c-99a4-d6858c882e4f tempest-VolumesCloneTest-1915872653 None] Acquiring lock "cinder-quobyte-707466b9-4a08-446e-ad57-a0b434ba5caf" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:18:37 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2bfacfd1-e2e9-437c-99a4-d6858c882e4f tempest-VolumesCloneTest-1915872653 None] Lock "cinder-quobyte-707466b9-4a08-446e-ad57-a0b434ba5caf" acquired by "delete_volume" :: waited 0.021s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:18:37 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5402b7ae-05c3-40fe-a11b-d2b5004d4f8a tempest-VolumesListAdminTestJSON-1979367101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7325baca-3f35-4b6c-9576-5d1f935627f0" returned: 0 in 0.986s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5402b7ae-05c3-40fe-a11b-d2b5004d4f8a tempest-VolumesListAdminTestJSON-1979367101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7325baca-3f35-4b6c-9576-5d1f935627f0 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:37 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[25acbd26-b2cb-4f19-b413-5ca85f954fa8]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:18:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2bfacfd1-e2e9-437c-99a4-d6858c882e4f tempest-VolumesCloneTest-1915872653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:37 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7325baca-3f35-4b6c-9576-5d1f935627f0 Jun 30 16:18:37 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:37 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf Jun 30 16:18:37 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:37 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b096f7d8-32fc-416c-84fc-92d359ff48a4 tempest-VolumesListAdminTestJSON-265112830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a0d23fff-a491-40d1-9519-345e2948893b" returned: 0 in 0.932s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b096f7d8-32fc-416c-84fc-92d359ff48a4 tempest-VolumesListAdminTestJSON-265112830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a0d23fff-a491-40d1-9519-345e2948893b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:37 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a0d23fff-a491-40d1-9519-345e2948893b Jun 30 16:18:37 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:37 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b6ca1718-c834-4b40-b285-824e0c881146 tempest-VolumesCloneTest-1915872653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.866s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:37 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-b6ca1718-c834-4b40-b285-824e0c881146 tempest-VolumesCloneTest-1915872653 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:18:37 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-b6ca1718-c834-4b40-b285-824e0c881146 tempest-VolumesCloneTest-1915872653 None] Deleted volume successfully. Jun 30 16:18:37 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b6ca1718-c834-4b40-b285-824e0c881146 tempest-VolumesCloneTest-1915872653 None] Lock "cinder-a2c0d6b2-00c2-4531-8393-aed9e55405a7-delete_volume" released by "delete_volume" :: held 2.830s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:18:38 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5402b7ae-05c3-40fe-a11b-d2b5004d4f8a tempest-VolumesListAdminTestJSON-1979367101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7325baca-3f35-4b6c-9576-5d1f935627f0" returned: 0 in 0.726s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5402b7ae-05c3-40fe-a11b-d2b5004d4f8a tempest-VolumesListAdminTestJSON-1979367101 None] Lock "cinder-quobyte-7325baca-3f35-4b6c-9576-5d1f935627f0" released by "delete_volume" :: held 1.763s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:18:38 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-5402b7ae-05c3-40fe-a11b-d2b5004d4f8a tempest-VolumesListAdminTestJSON-1979367101 None] Created reservations ['334dd1d7-fd57-440b-9ed6-354de126f55e', 'e848ad1d-ac28-4beb-93d4-5e77e2ae32db', '51605ec7-3028-4ef9-ad53-d4288788a8d8', '2f97d467-c743-4c8c-b1c2-4b04e03b5b7e'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:18:38 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2bfacfd1-e2e9-437c-99a4-d6858c882e4f tempest-VolumesCloneTest-1915872653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf" returned: 0 in 0.860s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2bfacfd1-e2e9-437c-99a4-d6858c882e4f tempest-VolumesCloneTest-1915872653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5402b7ae-05c3-40fe-a11b-d2b5004d4f8a tempest-VolumesListAdminTestJSON-1979367101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5402b7ae-05c3-40fe-a11b-d2b5004d4f8a tempest-VolumesListAdminTestJSON-1979367101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5402b7ae-05c3-40fe-a11b-d2b5004d4f8a tempest-VolumesListAdminTestJSON-1979367101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:18:38 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf Jun 30 16:18:38 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5402b7ae-05c3-40fe-a11b-d2b5004d4f8a tempest-VolumesListAdminTestJSON-1979367101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:18:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5402b7ae-05c3-40fe-a11b-d2b5004d4f8a tempest-VolumesListAdminTestJSON-1979367101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5402b7ae-05c3-40fe-a11b-d2b5004d4f8a tempest-VolumesListAdminTestJSON-1979367101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:38 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b096f7d8-32fc-416c-84fc-92d359ff48a4 tempest-VolumesListAdminTestJSON-265112830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a0d23fff-a491-40d1-9519-345e2948893b" returned: 0 in 0.772s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b096f7d8-32fc-416c-84fc-92d359ff48a4 tempest-VolumesListAdminTestJSON-265112830 None] Lock "cinder-quobyte-a0d23fff-a491-40d1-9519-345e2948893b" released by "delete_volume" :: held 1.756s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:18:38 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:18:38 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:38 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-b096f7d8-32fc-416c-84fc-92d359ff48a4 tempest-VolumesListAdminTestJSON-265112830 None] Created reservations ['aad8d0cc-f1c9-4d62-a909-9968fe46da2b', '2c823996-8f2f-4009-86d1-7a0be5037c1f', '9dea079b-cb49-4d6f-a8f8-0c969d985220', '93bb7595-c9b5-4eba-9882-aaf8b5f69814'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:18:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b096f7d8-32fc-416c-84fc-92d359ff48a4 tempest-VolumesListAdminTestJSON-265112830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b096f7d8-32fc-416c-84fc-92d359ff48a4 tempest-VolumesListAdminTestJSON-265112830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b096f7d8-32fc-416c-84fc-92d359ff48a4 tempest-VolumesListAdminTestJSON-265112830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:18:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b096f7d8-32fc-416c-84fc-92d359ff48a4 tempest-VolumesListAdminTestJSON-265112830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:18:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b096f7d8-32fc-416c-84fc-92d359ff48a4 tempest-VolumesListAdminTestJSON-265112830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b096f7d8-32fc-416c-84fc-92d359ff48a4 tempest-VolumesListAdminTestJSON-265112830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:38 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:18:38 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ac76204f-f5d6-4060-8b35-10624c3d750e tempest-VolumesListAdminTestJSON-265112830 None] Acquiring lock "cinder-a145911d-2621-4240-bc82-4cd4cf05567f-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:18:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ac76204f-f5d6-4060-8b35-10624c3d750e tempest-VolumesListAdminTestJSON-265112830 None] Lock "cinder-a145911d-2621-4240-bc82-4cd4cf05567f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:18:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ac76204f-f5d6-4060-8b35-10624c3d750e tempest-VolumesListAdminTestJSON-265112830 None] Acquiring lock "cinder-quobyte-a145911d-2621-4240-bc82-4cd4cf05567f" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:18:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ac76204f-f5d6-4060-8b35-10624c3d750e tempest-VolumesListAdminTestJSON-265112830 None] Lock "cinder-quobyte-a145911d-2621-4240-bc82-4cd4cf05567f" acquired by "delete_volume" :: waited 0.020s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:18:39 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[176c6724-f386-4920-9c08-06c0926cef97]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:18:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ac76204f-f5d6-4060-8b35-10624c3d750e tempest-VolumesListAdminTestJSON-265112830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a145911d-2621-4240-bc82-4cd4cf05567f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:39 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2bfacfd1-e2e9-437c-99a4-d6858c882e4f tempest-VolumesCloneTest-1915872653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-707466b9-4a08-446e-ad57-a0b434ba5caf" returned: 0 in 0.844s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2bfacfd1-e2e9-437c-99a4-d6858c882e4f tempest-VolumesCloneTest-1915872653 None] Lock "cinder-quobyte-707466b9-4a08-446e-ad57-a0b434ba5caf" released by "delete_volume" :: held 1.784s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:18:39 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5402b7ae-05c3-40fe-a11b-d2b5004d4f8a tempest-VolumesListAdminTestJSON-1979367101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.859s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:39 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-5402b7ae-05c3-40fe-a11b-d2b5004d4f8a tempest-VolumesListAdminTestJSON-1979367101 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:18:39 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-5402b7ae-05c3-40fe-a11b-d2b5004d4f8a tempest-VolumesListAdminTestJSON-1979367101 None] Deleted volume successfully. Jun 30 16:18:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5402b7ae-05c3-40fe-a11b-d2b5004d4f8a tempest-VolumesListAdminTestJSON-1979367101 None] Lock "cinder-7325baca-3f35-4b6c-9576-5d1f935627f0-delete_volume" released by "delete_volume" :: held 2.907s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:18:39 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-2bfacfd1-e2e9-437c-99a4-d6858c882e4f tempest-VolumesCloneTest-1915872653 None] Created reservations ['8339eaa2-ecb7-4e84-b067-e51d0183c0fe', 'bf1de198-91ad-44ac-81f4-a4dce017e9fc', 'be920de3-5a3d-4d65-a9e6-b57bfc07e9ea', '44578b94-9a83-48ce-aec6-9e948e69d33e'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:18:39 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a145911d-2621-4240-bc82-4cd4cf05567f Jun 30 16:18:39 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2bfacfd1-e2e9-437c-99a4-d6858c882e4f tempest-VolumesCloneTest-1915872653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2bfacfd1-e2e9-437c-99a4-d6858c882e4f tempest-VolumesCloneTest-1915872653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-2bfacfd1-e2e9-437c-99a4-d6858c882e4f tempest-VolumesCloneTest-1915872653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:18:39 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-2bfacfd1-e2e9-437c-99a4-d6858c882e4f tempest-VolumesCloneTest-1915872653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:18:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2bfacfd1-e2e9-437c-99a4-d6858c882e4f tempest-VolumesCloneTest-1915872653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2bfacfd1-e2e9-437c-99a4-d6858c882e4f tempest-VolumesCloneTest-1915872653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b096f7d8-32fc-416c-84fc-92d359ff48a4 tempest-VolumesListAdminTestJSON-265112830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.820s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:39 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-b096f7d8-32fc-416c-84fc-92d359ff48a4 tempest-VolumesListAdminTestJSON-265112830 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:18:39 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-b096f7d8-32fc-416c-84fc-92d359ff48a4 tempest-VolumesListAdminTestJSON-265112830 None] Deleted volume successfully. Jun 30 16:18:39 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:18:39 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b096f7d8-32fc-416c-84fc-92d359ff48a4 tempest-VolumesListAdminTestJSON-265112830 None] Lock "cinder-a0d23fff-a491-40d1-9519-345e2948893b-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:18:40 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ac76204f-f5d6-4060-8b35-10624c3d750e tempest-VolumesListAdminTestJSON-265112830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a145911d-2621-4240-bc82-4cd4cf05567f" returned: 0 in 0.882s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ac76204f-f5d6-4060-8b35-10624c3d750e tempest-VolumesListAdminTestJSON-265112830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a145911d-2621-4240-bc82-4cd4cf05567f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:40 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a145911d-2621-4240-bc82-4cd4cf05567f Jun 30 16:18:40 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:40 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2bfacfd1-e2e9-437c-99a4-d6858c882e4f tempest-VolumesCloneTest-1915872653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.695s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:40 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-2bfacfd1-e2e9-437c-99a4-d6858c882e4f tempest-VolumesCloneTest-1915872653 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:18:40 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-2bfacfd1-e2e9-437c-99a4-d6858c882e4f tempest-VolumesCloneTest-1915872653 None] Deleted volume successfully. Jun 30 16:18:40 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2bfacfd1-e2e9-437c-99a4-d6858c882e4f tempest-VolumesCloneTest-1915872653 None] Lock "cinder-707466b9-4a08-446e-ad57-a0b434ba5caf-delete_volume" released by "delete_volume" :: held 2.774s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:18:40 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ac76204f-f5d6-4060-8b35-10624c3d750e tempest-VolumesListAdminTestJSON-265112830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a145911d-2621-4240-bc82-4cd4cf05567f" returned: 0 in 0.706s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:40 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ac76204f-f5d6-4060-8b35-10624c3d750e tempest-VolumesListAdminTestJSON-265112830 None] Lock "cinder-quobyte-a145911d-2621-4240-bc82-4cd4cf05567f" released by "delete_volume" :: held 1.627s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:18:40 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-ac76204f-f5d6-4060-8b35-10624c3d750e tempest-VolumesListAdminTestJSON-265112830 None] Created reservations ['771bb6ff-7246-4226-b417-0d1d47a3b044', '239a0a9c-285a-4f70-9b59-db78fcccc158', 'ce6a0904-e76a-42ec-a3f6-49fff7d37e8e', 'afde122a-f725-420c-825c-12d4c6578530'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:18:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ac76204f-f5d6-4060-8b35-10624c3d750e tempest-VolumesListAdminTestJSON-265112830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ac76204f-f5d6-4060-8b35-10624c3d750e tempest-VolumesListAdminTestJSON-265112830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ac76204f-f5d6-4060-8b35-10624c3d750e tempest-VolumesListAdminTestJSON-265112830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:18:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ac76204f-f5d6-4060-8b35-10624c3d750e tempest-VolumesListAdminTestJSON-265112830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:18:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ac76204f-f5d6-4060-8b35-10624c3d750e tempest-VolumesListAdminTestJSON-265112830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ac76204f-f5d6-4060-8b35-10624c3d750e tempest-VolumesListAdminTestJSON-265112830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:41 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:18:41 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:41 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-20f5b368-ad09-40c4-9bf7-ba5ea1655c24 tempest-VolumesListAdminTestJSON-265112830 None] Acquiring lock "cinder-bd30e56b-8a79-4682-a919-6cfef2bedbf5-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:18:41 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-20f5b368-ad09-40c4-9bf7-ba5ea1655c24 tempest-VolumesListAdminTestJSON-265112830 None] Lock "cinder-bd30e56b-8a79-4682-a919-6cfef2bedbf5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:18:41 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-20f5b368-ad09-40c4-9bf7-ba5ea1655c24 tempest-VolumesListAdminTestJSON-265112830 None] Acquiring lock "cinder-quobyte-bd30e56b-8a79-4682-a919-6cfef2bedbf5" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:18:41 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-20f5b368-ad09-40c4-9bf7-ba5ea1655c24 tempest-VolumesListAdminTestJSON-265112830 None] Lock "cinder-quobyte-bd30e56b-8a79-4682-a919-6cfef2bedbf5" acquired by "delete_volume" :: waited 0.021s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:18:41 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[5449884e-60c9-4c14-b8b0-5bbfe595f3fe]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:18:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-20f5b368-ad09-40c4-9bf7-ba5ea1655c24 tempest-VolumesListAdminTestJSON-265112830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bd30e56b-8a79-4682-a919-6cfef2bedbf5 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:41 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ac76204f-f5d6-4060-8b35-10624c3d750e tempest-VolumesListAdminTestJSON-265112830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.730s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:41 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-ac76204f-f5d6-4060-8b35-10624c3d750e tempest-VolumesListAdminTestJSON-265112830 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:18:41 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-ac76204f-f5d6-4060-8b35-10624c3d750e tempest-VolumesListAdminTestJSON-265112830 None] Deleted volume successfully. Jun 30 16:18:41 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bd30e56b-8a79-4682-a919-6cfef2bedbf5 Jun 30 16:18:41 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:41 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ac76204f-f5d6-4060-8b35-10624c3d750e tempest-VolumesListAdminTestJSON-265112830 None] Lock "cinder-a145911d-2621-4240-bc82-4cd4cf05567f-delete_volume" released by "delete_volume" :: held 2.623s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:18:42 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-20f5b368-ad09-40c4-9bf7-ba5ea1655c24 tempest-VolumesListAdminTestJSON-265112830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bd30e56b-8a79-4682-a919-6cfef2bedbf5" returned: 0 in 0.801s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-20f5b368-ad09-40c4-9bf7-ba5ea1655c24 tempest-VolumesListAdminTestJSON-265112830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bd30e56b-8a79-4682-a919-6cfef2bedbf5 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:42 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bd30e56b-8a79-4682-a919-6cfef2bedbf5 Jun 30 16:18:42 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:42 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:18:42 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Flow 'volume_create_manager' (b5edc119-d910-4ed8-9975-a0bae3b97e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:18:42 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555599dd-7c22-44d3-a314-ac64c7614dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:42 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555599dd-7c22-44d3-a314-ac64c7614dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-899128990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6657831476d14da093f8d443bb3b1169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:18:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:18:43Z,use_quota=True,user_id='b64b63b6b2d446bd8525b394740594fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:42 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65407624-4ea5-4b3e-ba19-8dd7335b6487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:42 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65407624-4ea5-4b3e-ba19-8dd7335b6487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66baa363-fce9-4e35-8086-640c84b6d86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66baa363-fce9-4e35-8086-640c84b6d86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49', 'volume_name': 'volume-42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49', 'volume_size': 2}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57603128-67d7-4f00-b1de-2806b071a88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57603128-67d7-4f00-b1de-2806b071a88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9de130e-2e4f-4a09-82db-3fb2179db58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:43 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Volume 42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49', 'volume_size': 2} Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-899128990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6657831476d14da093f8d443bb3b1169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:18:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:18:43Z,use_quota=True,user_id='b64b63b6b2d446bd8525b394740594fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Creating volume 42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:18:43 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49 2147483648 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:43 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49 2147483648 Jun 30 16:18:43 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:43 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-20f5b368-ad09-40c4-9bf7-ba5ea1655c24 tempest-VolumesListAdminTestJSON-265112830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-bd30e56b-8a79-4682-a919-6cfef2bedbf5" returned: 0 in 0.680s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-20f5b368-ad09-40c4-9bf7-ba5ea1655c24 tempest-VolumesListAdminTestJSON-265112830 None] Lock "cinder-quobyte-bd30e56b-8a79-4682-a919-6cfef2bedbf5" released by "delete_volume" :: held 1.541s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-20f5b368-ad09-40c4-9bf7-ba5ea1655c24 tempest-VolumesListAdminTestJSON-265112830 None] Created reservations ['b6186a8d-2574-47d0-902f-9da25d93f8b5', 'efef0f1b-ac82-48fb-99f5-1512e8622909', 'c2cc0d6b-c59e-453d-b1c9-a24bc5d1f6cb', 'ff78e31f-955a-4231-aec7-ed571a89fc70'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-20f5b368-ad09-40c4-9bf7-ba5ea1655c24 tempest-VolumesListAdminTestJSON-265112830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-20f5b368-ad09-40c4-9bf7-ba5ea1655c24 tempest-VolumesListAdminTestJSON-265112830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-20f5b368-ad09-40c4-9bf7-ba5ea1655c24 tempest-VolumesListAdminTestJSON-265112830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-20f5b368-ad09-40c4-9bf7-ba5ea1655c24 tempest-VolumesListAdminTestJSON-265112830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-20f5b368-ad09-40c4-9bf7-ba5ea1655c24 tempest-VolumesListAdminTestJSON-265112830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-20f5b368-ad09-40c4-9bf7-ba5ea1655c24 tempest-VolumesListAdminTestJSON-265112830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:43 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:18:43 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:44 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-20f5b368-ad09-40c4-9bf7-ba5ea1655c24 tempest-VolumesListAdminTestJSON-265112830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.741s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:44 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-20f5b368-ad09-40c4-9bf7-ba5ea1655c24 tempest-VolumesListAdminTestJSON-265112830 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:18:44 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-20f5b368-ad09-40c4-9bf7-ba5ea1655c24 tempest-VolumesListAdminTestJSON-265112830 None] Deleted volume successfully. Jun 30 16:18:44 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-20f5b368-ad09-40c4-9bf7-ba5ea1655c24 tempest-VolumesListAdminTestJSON-265112830 None] Lock "cinder-bd30e56b-8a79-4682-a919-6cfef2bedbf5-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:18:44 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49 2147483648" returned: 0 in 1.050s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:44 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49 Jun 30 16:18:44 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:44 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49" returned: 0 in 0.701s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:44 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:18:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9de130e-2e4f-4a09-82db-3fb2179db58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49', 'volume_size': 2}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec1b7ff-ddba-4e5b-bdbd-00665f46e1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:44 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Volume volume-42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49 (42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49): created successfully Jun 30 16:18:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec1b7ff-ddba-4e5b-bdbd-00665f46e1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Flow 'volume_create_manager' (b5edc119-d910-4ed8-9975-a0bae3b97e9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:18:44 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-07c3853c-dab5-4e31-b442-b3ab15239641 tempest-VolumesCloneNegativeTest-548068966 None] Created volume successfully. Jun 30 16:18:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ced1fdc3-f540-461a-ab6b-76ad69549c49 tempest-VolumesCloneNegativeTest-548068966 None] Acquiring lock "cinder-42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:18:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ced1fdc3-f540-461a-ab6b-76ad69549c49 tempest-VolumesCloneNegativeTest-548068966 None] Lock "cinder-42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:18:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ced1fdc3-f540-461a-ab6b-76ad69549c49 tempest-VolumesCloneNegativeTest-548068966 None] Acquiring lock "cinder-quobyte-42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:18:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ced1fdc3-f540-461a-ab6b-76ad69549c49 tempest-VolumesCloneNegativeTest-548068966 None] Lock "cinder-quobyte-42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49" acquired by "delete_volume" :: waited 0.016s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:18:45 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[db14dba9-e18f-4178-8f64-511531e31110]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:18:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ced1fdc3-f540-461a-ab6b-76ad69549c49 tempest-VolumesCloneNegativeTest-548068966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:45 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49 Jun 30 16:18:45 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:46 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ced1fdc3-f540-461a-ab6b-76ad69549c49 tempest-VolumesCloneNegativeTest-548068966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49" returned: 0 in 0.758s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ced1fdc3-f540-461a-ab6b-76ad69549c49 tempest-VolumesCloneNegativeTest-548068966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:46 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49 Jun 30 16:18:46 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:46 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ced1fdc3-f540-461a-ab6b-76ad69549c49 tempest-VolumesCloneNegativeTest-548068966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49" returned: 0 in 0.665s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:46 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ced1fdc3-f540-461a-ab6b-76ad69549c49 tempest-VolumesCloneNegativeTest-548068966 None] Lock "cinder-quobyte-42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49" released by "delete_volume" :: held 1.489s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:18:46 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-ced1fdc3-f540-461a-ab6b-76ad69549c49 tempest-VolumesCloneNegativeTest-548068966 None] Created reservations ['ba51f375-f61b-4663-b4e1-8617df720bcb', '412c27c2-b3a2-4c20-b7f1-7c7de8d7f355', 'e8daed96-e3c1-4e42-be7e-83eaddc32e77', 'c54d4898-d0d0-40bc-aeac-10a09b829f75'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:18:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ced1fdc3-f540-461a-ab6b-76ad69549c49 tempest-VolumesCloneNegativeTest-548068966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ced1fdc3-f540-461a-ab6b-76ad69549c49 tempest-VolumesCloneNegativeTest-548068966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:46 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ced1fdc3-f540-461a-ab6b-76ad69549c49 tempest-VolumesCloneNegativeTest-548068966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:18:46 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ced1fdc3-f540-461a-ab6b-76ad69549c49 tempest-VolumesCloneNegativeTest-548068966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:18:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ced1fdc3-f540-461a-ab6b-76ad69549c49 tempest-VolumesCloneNegativeTest-548068966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ced1fdc3-f540-461a-ab6b-76ad69549c49 tempest-VolumesCloneNegativeTest-548068966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:46 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:18:46 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:47 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ced1fdc3-f540-461a-ab6b-76ad69549c49 tempest-VolumesCloneNegativeTest-548068966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.694s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:47 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-ced1fdc3-f540-461a-ab6b-76ad69549c49 tempest-VolumesCloneNegativeTest-548068966 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:18:47 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-ced1fdc3-f540-461a-ab6b-76ad69549c49 tempest-VolumesCloneNegativeTest-548068966 None] Deleted volume successfully. Jun 30 16:18:47 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ced1fdc3-f540-461a-ab6b-76ad69549c49 tempest-VolumesCloneNegativeTest-548068966 None] Lock "cinder-42f05b0a-0954-4a84-bc0d-2bd1e6b1ae49-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:18:48 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:18:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Flow 'volume_create_manager' (723a73f8-1761-4045-90b4-fab27c711788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:18:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2066f672-8d67-4ee0-b79a-85362610ead3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2066f672-8d67-4ee0-b79a-85362610ead3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1141465625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=399d159e-39a7-460f-a382-7429928c4af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34842a89810849dea68b294a49769025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:18:48Z,use_quota=True,user_id='e13e9679213249c58a82c8376226cbc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c0479d-4f4a-458c-89ee-ca8887e14c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c0479d-4f4a-458c-89ee-ca8887e14c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d3470c-db63-40c7-8d00-1766e842c62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d3470c-db63-40c7-8d00-1766e842c62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '399d159e-39a7-460f-a382-7429928c4af0', 'volume_name': 'volume-399d159e-39a7-460f-a382-7429928c4af0', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8538976a-9a1c-4f8d-b08e-56b61517295e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8538976a-9a1c-4f8d-b08e-56b61517295e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd599b6-1e66-467a-beaf-9e910db64d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:48 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Volume 399d159e-39a7-460f-a382-7429928c4af0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-399d159e-39a7-460f-a382-7429928c4af0', 'volume_size': 1} Jun 30 16:18:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:48 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1141465625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=399d159e-39a7-460f-a382-7429928c4af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34842a89810849dea68b294a49769025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:18:48Z,use_quota=True,user_id='e13e9679213249c58a82c8376226cbc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:18:48 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Creating volume 399d159e-39a7-460f-a382-7429928c4af0 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:18:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:48 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:18:48 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:18:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:48 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:18:48 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:18:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:48 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0 1073741824 Jun 30 16:18:48 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:49 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0 1073741824" returned: 0 in 0.925s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:49 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0 Jun 30 16:18:49 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:49 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0" returned: 0 in 0.659s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:18:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd599b6-1e66-467a-beaf-9e910db64d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-399d159e-39a7-460f-a382-7429928c4af0', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12527294-3138-4ad8-87eb-be7983b62b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:49 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Volume volume-399d159e-39a7-460f-a382-7429928c4af0 (399d159e-39a7-460f-a382-7429928c4af0): created successfully Jun 30 16:18:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12527294-3138-4ad8-87eb-be7983b62b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Flow 'volume_create_manager' (723a73f8-1761-4045-90b4-fab27c711788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:18:49 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-451a5e87-ada1-4e5e-84e1-65126587f7d3 tempest-SnapshotMetadataTestJSON-1000309502 None] Created volume successfully. Jun 30 16:18:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-43fb3ab4-0953-475c-b1fa-b9f9fa4fbf32 tempest-SnapshotMetadataTestJSON-1000309502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-43fb3ab4-0953-475c-b1fa-b9f9fa4fbf32 tempest-SnapshotMetadataTestJSON-1000309502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:50 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-43fb3ab4-0953-475c-b1fa-b9f9fa4fbf32 tempest-SnapshotMetadataTestJSON-1000309502 None] Creating offline snapshot 2664be22-0122-42ce-8cf9-c2f9d00faaa7 of volume 399d159e-39a7-460f-a382-7429928c4af0 {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:18:50 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62bef88-33f1-4fdb-8465-81ef861b02dd]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:18:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-43fb3ab4-0953-475c-b1fa-b9f9fa4fbf32 tempest-SnapshotMetadataTestJSON-1000309502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:50 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0 Jun 30 16:18:50 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:50 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:18:50 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Flow 'volume_create_manager' (182e892e-adf7-4d70-9e01-90ac52cb9034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:18:50 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045ab572-ff66-4a3f-8f2c-1f7b61243798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:50 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045ab572-ff66-4a3f-8f2c-1f7b61243798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1226552377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ab2229-1fe9-43a7-b64f-623dba584b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f7b5a339e34b31b677060b1b624dd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:18:51Z,use_quota=True,user_id='4a1ff57bbca74948b295cf65820b2189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:50 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6f6867-cea3-465e-87b1-94650c25f504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6f6867-cea3-465e-87b1-94650c25f504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43209fc2-39ac-45e1-97dd-92fc41e43857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:51 devstack cinder-volume[93781]: DEBUG cinder.image.glance [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Creating Keystone auth plugin from conf {{(pid=93781) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 30 16:18:51 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-43fb3ab4-0953-475c-b1fa-b9f9fa4fbf32 tempest-SnapshotMetadataTestJSON-1000309502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0" returned: 0 in 0.869s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-43fb3ab4-0953-475c-b1fa-b9f9fa4fbf32 tempest-SnapshotMetadataTestJSON-1000309502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.2664be22-0122-42ce-8cf9-c2f9d00faaa7 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:51 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.2664be22-0122-42ce-8cf9-c2f9d00faaa7 1G Jun 30 16:18:51 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43209fc2-39ac-45e1-97dd-92fc41e43857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '71ab2229-1fe9-43a7-b64f-623dba584b68', 'volume_name': 'volume-71ab2229-1fe9-43a7-b64f-623dba584b68', 'volume_size': 1, 'image_id': '2303c773-75d0-4542-ba21-750c84d63b39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a85030669b0434f9a3a845e0c4388d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2303c773-75d0-4542-ba21-750c84d63b39', 'created_at': datetime.datetime(2026, 6, 30, 13, 59, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 13, 59, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2303c773-75d0-4542-ba21-750c84d63b39/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e59d5d8-9b8e-4692-b97f-77cf37be76b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e59d5d8-9b8e-4692-b97f-77cf37be76b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:18:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00c898f-93a5-4ee4-8569-afb6b7f88c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:18:51 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Volume 71ab2229-1fe9-43a7-b64f-623dba584b68: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-71ab2229-1fe9-43a7-b64f-623dba584b68', 'volume_size': 1, 'image_id': '2303c773-75d0-4542-ba21-750c84d63b39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a85030669b0434f9a3a845e0c4388d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2303c773-75d0-4542-ba21-750c84d63b39', 'created_at': datetime.datetime(2026, 6, 30, 13, 59, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 13, 59, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2303c773-75d0-4542-ba21-750c84d63b39/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 30 16:18:51 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Trying to clone 71ab2229-1fe9-43a7-b64f-623dba584b68 from image 2303c773-75d0-4542-ba21-750c84d63b39 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}]). {{(pid=93781) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 30 16:18:51 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_bd8ya3kldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 30 16:18:51 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Image download 20.69 MB at 20.69 MB/s Jun 30 16:18:51 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7f711f-e196-4805-ac21-1a54fc5b2467]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:18:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_bd8ya3kldevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:51 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_bd8ya3kldevstack@QuobyteHD Jun 30 16:18:51 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:52 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-43fb3ab4-0953-475c-b1fa-b9f9fa4fbf32 tempest-SnapshotMetadataTestJSON-1000309502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.2664be22-0122-42ce-8cf9-c2f9d00faaa7 1G" returned: 0 in 0.909s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-43fb3ab4-0953-475c-b1fa-b9f9fa4fbf32 tempest-SnapshotMetadataTestJSON-1000309502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-399d159e-39a7-460f-a382-7429928c4af0 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.2664be22-0122-42ce-8cf9-c2f9d00faaa7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:52 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-399d159e-39a7-460f-a382-7429928c4af0 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.2664be22-0122-42ce-8cf9-c2f9d00faaa7 Jun 30 16:18:52 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:52 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_bd8ya3kldevstack@QuobyteHD" returned: 0 in 0.827s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:52 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Temporary image 2303c773-75d0-4542-ba21-750c84d63b39 is fetched for user 4a1ff57bbca74948b295cf65820b2189. {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 30 16:18:52 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7454311-5191-43de-bdb1-65c54844a665]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:18:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_bd8ya3kldevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:52 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_bd8ya3kldevstack@QuobyteHD Jun 30 16:18:52 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:52 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-43fb3ab4-0953-475c-b1fa-b9f9fa4fbf32 tempest-SnapshotMetadataTestJSON-1000309502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-399d159e-39a7-460f-a382-7429928c4af0 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.2664be22-0122-42ce-8cf9-c2f9d00faaa7" returned: 0 in 0.707s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:52 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-43fb3ab4-0953-475c-b1fa-b9f9fa4fbf32 tempest-SnapshotMetadataTestJSON-1000309502 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.2664be22-0122-42ce-8cf9-c2f9d00faaa7 is being set with open permissions: ugo+rw Jun 30 16:18:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-43fb3ab4-0953-475c-b1fa-b9f9fa4fbf32 tempest-SnapshotMetadataTestJSON-1000309502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.2664be22-0122-42ce-8cf9-c2f9d00faaa7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:52 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.2664be22-0122-42ce-8cf9-c2f9d00faaa7 Jun 30 16:18:52 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:53 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_bd8ya3kldevstack@QuobyteHD" returned: 0 in 0.754s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:53 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-43fb3ab4-0953-475c-b1fa-b9f9fa4fbf32 tempest-SnapshotMetadataTestJSON-1000309502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.2664be22-0122-42ce-8cf9-c2f9d00faaa7" returned: 0 in 0.649s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-43fb3ab4-0953-475c-b1fa-b9f9fa4fbf32 tempest-SnapshotMetadataTestJSON-1000309502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:53 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.info Jun 30 16:18:53 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:54 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-43fb3ab4-0953-475c-b1fa-b9f9fa4fbf32 tempest-SnapshotMetadataTestJSON-1000309502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.info" returned: 0 in 0.649s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:54 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-43fb3ab4-0953-475c-b1fa-b9f9fa4fbf32 tempest-SnapshotMetadataTestJSON-1000309502 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.info is being set with open permissions: ugo+rw Jun 30 16:18:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-43fb3ab4-0953-475c-b1fa-b9f9fa4fbf32 tempest-SnapshotMetadataTestJSON-1000309502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:54 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.info Jun 30 16:18:54 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:54 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-43fb3ab4-0953-475c-b1fa-b9f9fa4fbf32 tempest-SnapshotMetadataTestJSON-1000309502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.info" returned: 0 in 0.641s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-43fb3ab4-0953-475c-b1fa-b9f9fa4fbf32 tempest-SnapshotMetadataTestJSON-1000309502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.521s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.477s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1226552377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ab2229-1fe9-43a7-b64f-623dba584b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f7b5a339e34b31b677060b1b624dd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:18:51Z,use_quota=True,user_id='4a1ff57bbca74948b295cf65820b2189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:18:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Creating volume 71ab2229-1fe9-43a7-b64f-623dba584b68 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:18:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:18:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:18:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:18:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:18:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:18:54 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:18:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:54 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 1073741824 Jun 30 16:18:54 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:54 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-43fb3ab4-0953-475c-b1fa-b9f9fa4fbf32 tempest-SnapshotMetadataTestJSON-1000309502 None] Create snapshot completed successfully Jun 30 16:18:55 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 1073741824" returned: 0 in 0.876s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:55 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 Jun 30 16:18:55 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e64b258e-13a1-4b9d-906b-dd198141a747 tempest-SnapshotMetadataTestJSON-1000309502 None] Acquiring lock "cinder-2664be22-0122-42ce-8cf9-c2f9d00faaa7-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:18:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e64b258e-13a1-4b9d-906b-dd198141a747 tempest-SnapshotMetadataTestJSON-1000309502 None] Lock "cinder-2664be22-0122-42ce-8cf9-c2f9d00faaa7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:18:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e64b258e-13a1-4b9d-906b-dd198141a747 tempest-SnapshotMetadataTestJSON-1000309502 None] Acquiring lock "cinder-quobyte-399d159e-39a7-460f-a382-7429928c4af0" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:18:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e64b258e-13a1-4b9d-906b-dd198141a747 tempest-SnapshotMetadataTestJSON-1000309502 None] Lock "cinder-quobyte-399d159e-39a7-460f-a382-7429928c4af0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:18:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e64b258e-13a1-4b9d-906b-dd198141a747 tempest-SnapshotMetadataTestJSON-1000309502 None] Acquiring lock "cinder-quobyte-2664be22-0122-42ce-8cf9-c2f9d00faaa7" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:18:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e64b258e-13a1-4b9d-906b-dd198141a747 tempest-SnapshotMetadataTestJSON-1000309502 None] Lock "cinder-quobyte-2664be22-0122-42ce-8cf9-c2f9d00faaa7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:18:56 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-e64b258e-13a1-4b9d-906b-dd198141a747 tempest-SnapshotMetadataTestJSON-1000309502 None] Deleting offline snapshot 2664be22-0122-42ce-8cf9-c2f9d00faaa7 of volume 399d159e-39a7-460f-a382-7429928c4af0 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:18:56 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-e64b258e-13a1-4b9d-906b-dd198141a747 tempest-SnapshotMetadataTestJSON-1000309502 None] snapshot_file for this snap is: volume-399d159e-39a7-460f-a382-7429928c4af0.2664be22-0122-42ce-8cf9-c2f9d00faaa7 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:18:56 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a034e3-4afe-47bd-8dc1-658450b492ca]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:18:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e64b258e-13a1-4b9d-906b-dd198141a747 tempest-SnapshotMetadataTestJSON-1000309502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.2664be22-0122-42ce-8cf9-c2f9d00faaa7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:56 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.2664be22-0122-42ce-8cf9-c2f9d00faaa7 Jun 30 16:18:56 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:56 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68" returned: 0 in 0.668s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:56 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:18:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:18:56 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Attempting download of 2303c773-75d0-4542-ba21-750c84d63b39 ((None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}])) to volume 71ab2229-1fe9-43a7-b64f-623dba584b68. {{(pid=93781) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 30 16:18:56 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[b436e52c-80b5-45ab-8e94-dd9618b66ccd]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:18:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_jm6xoi__ {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:56 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_jm6xoi__ Jun 30 16:18:56 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:57 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e64b258e-13a1-4b9d-906b-dd198141a747 tempest-SnapshotMetadataTestJSON-1000309502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.2664be22-0122-42ce-8cf9-c2f9d00faaa7" returned: 0 in 0.765s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:57 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-e64b258e-13a1-4b9d-906b-dd198141a747 tempest-SnapshotMetadataTestJSON-1000309502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-399d159e-39a7-460f-a382-7429928c4af0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:18:57 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[657c21a8-c741-4d33-a936-54cd7535cde0]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:18:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e64b258e-13a1-4b9d-906b-dd198141a747 tempest-SnapshotMetadataTestJSON-1000309502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:57 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0 Jun 30 16:18:57 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:57 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_jm6xoi__" returned: 0 in 0.722s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_jm6xoi__ {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:57 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_jm6xoi__ Jun 30 16:18:57 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:57 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e64b258e-13a1-4b9d-906b-dd198141a747 tempest-SnapshotMetadataTestJSON-1000309502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0" returned: 0 in 0.760s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e64b258e-13a1-4b9d-906b-dd198141a747 tempest-SnapshotMetadataTestJSON-1000309502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.2664be22-0122-42ce-8cf9-c2f9d00faaa7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:57 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.2664be22-0122-42ce-8cf9-c2f9d00faaa7 Jun 30 16:18:57 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:57 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_jm6xoi__" returned: 1 in 0.718s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_jm6xoi__' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:18:57 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2843aa0-5196-49b4-b8b2-65325db19105]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:18:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_bd8ya3kldevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:58 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_bd8ya3kldevstack@QuobyteHD Jun 30 16:18:58 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:58 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e64b258e-13a1-4b9d-906b-dd198141a747 tempest-SnapshotMetadataTestJSON-1000309502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.2664be22-0122-42ce-8cf9-c2f9d00faaa7" returned: 0 in 0.775s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e64b258e-13a1-4b9d-906b-dd198141a747 tempest-SnapshotMetadataTestJSON-1000309502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.2664be22-0122-42ce-8cf9-c2f9d00faaa7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:58 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.2664be22-0122-42ce-8cf9-c2f9d00faaa7 Jun 30 16:18:58 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:58 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_bd8ya3kldevstack@QuobyteHD" returned: 0 in 0.758s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:58 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] 2303c773-75d0-4542-ba21-750c84d63b39 was qcow2, converting to raw {{(pid=93781) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 30 16:18:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_bd8ya3kldevstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:18:58 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_bd8ya3kldevstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 Jun 30 16:18:58 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:18:59 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jun 30 16:18:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e64b258e-13a1-4b9d-906b-dd198141a747 tempest-SnapshotMetadataTestJSON-1000309502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0.2664be22-0122-42ce-8cf9-c2f9d00faaa7" returned: 0 in 0.673s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:18:59 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e64b258e-13a1-4b9d-906b-dd198141a747 tempest-SnapshotMetadataTestJSON-1000309502 None] Lock "cinder-quobyte-2664be22-0122-42ce-8cf9-c2f9d00faaa7" released by "_delete_snapshot" :: held 3.091s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:18:59 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e64b258e-13a1-4b9d-906b-dd198141a747 tempest-SnapshotMetadataTestJSON-1000309502 None] Lock "cinder-quobyte-399d159e-39a7-460f-a382-7429928c4af0" released by "delete_snapshot" :: held 3.116s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:18:59 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-e64b258e-13a1-4b9d-906b-dd198141a747 tempest-SnapshotMetadataTestJSON-1000309502 None] Created reservations ['02e3445c-ff93-4551-9a57-699299201f5b', '5c863d1c-84b5-4d47-9f96-2a22b2191158', 'a6d57d7e-1e83-4abc-8bac-553346aa2ebd', 'fb28128e-32f9-4d4b-958b-0695cdfa40b5'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:18:59 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-e64b258e-13a1-4b9d-906b-dd198141a747 tempest-SnapshotMetadataTestJSON-1000309502 None] Delete snapshot completed successfully. Jun 30 16:18:59 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e64b258e-13a1-4b9d-906b-dd198141a747 tempest-SnapshotMetadataTestJSON-1000309502 None] Lock "cinder-2664be22-0122-42ce-8cf9-c2f9d00faaa7-delete_snapshot" released by "delete_snapshot" :: held 3.280s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:19:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e72b05c9-e1b1-40eb-8e0d-3f5edf86a6b2 tempest-SnapshotMetadataTestJSON-1000309502 None] Acquiring lock "cinder-399d159e-39a7-460f-a382-7429928c4af0-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e72b05c9-e1b1-40eb-8e0d-3f5edf86a6b2 tempest-SnapshotMetadataTestJSON-1000309502 None] Lock "cinder-399d159e-39a7-460f-a382-7429928c4af0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:00 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=75,cinder:INSERT=27,cinder:UPDATE=114,cinder:DELETE=8 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:19:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e72b05c9-e1b1-40eb-8e0d-3f5edf86a6b2 tempest-SnapshotMetadataTestJSON-1000309502 None] Acquiring lock "cinder-quobyte-399d159e-39a7-460f-a382-7429928c4af0" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e72b05c9-e1b1-40eb-8e0d-3f5edf86a6b2 tempest-SnapshotMetadataTestJSON-1000309502 None] Lock "cinder-quobyte-399d159e-39a7-460f-a382-7429928c4af0" acquired by "delete_volume" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:00 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[052f5fd6-1cfb-4ce3-8877-8f7ce34b3b66]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:19:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e72b05c9-e1b1-40eb-8e0d-3f5edf86a6b2 tempest-SnapshotMetadataTestJSON-1000309502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:00 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0 Jun 30 16:19:00 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:00 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_bd8ya3kldevstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68" returned: 0 in 2.185s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:00 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_bd8ya3kldevstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:19:00 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Converted 112.00 MB image at 51.22 MB/s Jun 30 16:19:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:00 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 1G Jun 30 16:19:00 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:01 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e72b05c9-e1b1-40eb-8e0d-3f5edf86a6b2 tempest-SnapshotMetadataTestJSON-1000309502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0" returned: 0 in 0.810s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e72b05c9-e1b1-40eb-8e0d-3f5edf86a6b2 tempest-SnapshotMetadataTestJSON-1000309502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:01 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0 Jun 30 16:19:01 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:01 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 1G" returned: 0 in 0.730s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:01 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a4525f-9d0d-440c-95cc-ddea9ecc4a36]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:19:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:01 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 Jun 30 16:19:01 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:02 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e72b05c9-e1b1-40eb-8e0d-3f5edf86a6b2 tempest-SnapshotMetadataTestJSON-1000309502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-399d159e-39a7-460f-a382-7429928c4af0" returned: 0 in 0.710s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:02 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e72b05c9-e1b1-40eb-8e0d-3f5edf86a6b2 tempest-SnapshotMetadataTestJSON-1000309502 None] Lock "cinder-quobyte-399d159e-39a7-460f-a382-7429928c4af0" released by "delete_volume" :: held 1.595s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:19:02 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-e72b05c9-e1b1-40eb-8e0d-3f5edf86a6b2 tempest-SnapshotMetadataTestJSON-1000309502 None] Created reservations ['40c2df49-9691-4feb-b3e1-81f24d80a325', 'b15d5b47-b480-47b7-ae02-c7fa2881e234', '8d127a02-22fa-44f5-b8a3-a6a73dc26c68', 'f0110c1d-b08b-4902-9c64-80ff63f974d8'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:19:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e72b05c9-e1b1-40eb-8e0d-3f5edf86a6b2 tempest-SnapshotMetadataTestJSON-1000309502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e72b05c9-e1b1-40eb-8e0d-3f5edf86a6b2 tempest-SnapshotMetadataTestJSON-1000309502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e72b05c9-e1b1-40eb-8e0d-3f5edf86a6b2 tempest-SnapshotMetadataTestJSON-1000309502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:19:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e72b05c9-e1b1-40eb-8e0d-3f5edf86a6b2 tempest-SnapshotMetadataTestJSON-1000309502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:19:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e72b05c9-e1b1-40eb-8e0d-3f5edf86a6b2 tempest-SnapshotMetadataTestJSON-1000309502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e72b05c9-e1b1-40eb-8e0d-3f5edf86a6b2 tempest-SnapshotMetadataTestJSON-1000309502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:02 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:19:02 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:02 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68" returned: 0 in 0.769s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:02 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 Jun 30 16:19:02 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:03 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e72b05c9-e1b1-40eb-8e0d-3f5edf86a6b2 tempest-SnapshotMetadataTestJSON-1000309502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.713s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:03 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-e72b05c9-e1b1-40eb-8e0d-3f5edf86a6b2 tempest-SnapshotMetadataTestJSON-1000309502 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:19:03 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-e72b05c9-e1b1-40eb-8e0d-3f5edf86a6b2 tempest-SnapshotMetadataTestJSON-1000309502 None] Deleted volume successfully. Jun 30 16:19:03 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e72b05c9-e1b1-40eb-8e0d-3f5edf86a6b2 tempest-SnapshotMetadataTestJSON-1000309502 None] Lock "cinder-399d159e-39a7-460f-a382-7429928c4af0-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:19:03 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68" returned: 1 in 0.778s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:19:03 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Downloaded image 2303c773-75d0-4542-ba21-750c84d63b39 ((None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}])) to volume 71ab2229-1fe9-43a7-b64f-623dba584b68 successfully. {{(pid=93781) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 30 16:19:03 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Temporary image 2303c773-75d0-4542-ba21-750c84d63b39 for user 4a1ff57bbca74948b295cf65820b2189 is deleted. {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 30 16:19:03 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Marking volume 71ab2229-1fe9-43a7-b64f-623dba584b68 as bootable. {{(pid=93781) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 30 16:19:03 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Copying metadata from image 2303c773-75d0-4542-ba21-750c84d63b39 to 71ab2229-1fe9-43a7-b64f-623dba584b68. {{(pid=93781) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 30 16:19:03 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Creating volume glance metadata for volume 71ab2229-1fe9-43a7-b64f-623dba584b68 backed by image 2303c773-75d0-4542-ba21-750c84d63b39 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2303c773-75d0-4542-ba21-750c84d63b39', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93781) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 30 16:19:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00c898f-93a5-4ee4-8569-afb6b7f88c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71ab2229-1fe9-43a7-b64f-623dba584b68', 'volume_size': 1, 'image_id': '2303c773-75d0-4542-ba21-750c84d63b39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a85030669b0434f9a3a845e0c4388d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2303c773-75d0-4542-ba21-750c84d63b39', 'created_at': datetime.datetime(2026, 6, 30, 13, 59, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 13, 59, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2303c773-75d0-4542-ba21-750c84d63b39/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (760f40d7-183f-41db-aea3-f9e6b5f46497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:03 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Volume volume-71ab2229-1fe9-43a7-b64f-623dba584b68 (71ab2229-1fe9-43a7-b64f-623dba584b68): created successfully Jun 30 16:19:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (760f40d7-183f-41db-aea3-f9e6b5f46497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Flow 'volume_create_manager' (182e892e-adf7-4d70-9e01-90ac52cb9034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:19:03 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-1cc7e1aa-6848-4926-88a0-4bbdf79c43a8 tempest-VolumesExtendTest-986821320 None] Created volume successfully. Jun 30 16:19:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-613b2e80-19d5-4f35-8d32-330e940031b7 tempest-VolumesExtendTest-986821320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-613b2e80-19d5-4f35-8d32-330e940031b7 tempest-VolumesExtendTest-986821320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:03 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dec90d-5e13-4ea0-9b47-5cd138aecf11]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:19:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-613b2e80-19d5-4f35-8d32-330e940031b7 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:03 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 Jun 30 16:19:03 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:04 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-613b2e80-19d5-4f35-8d32-330e940031b7 tempest-VolumesExtendTest-986821320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68" returned: 0 in 0.862s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-613b2e80-19d5-4f35-8d32-330e940031b7 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:04 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 Jun 30 16:19:04 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:05 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-613b2e80-19d5-4f35-8d32-330e940031b7 tempest-VolumesExtendTest-986821320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68" returned: 1 in 0.819s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-613b2e80-19d5-4f35-8d32-330e940031b7 tempest-VolumesExtendTest-986821320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:19:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-613b2e80-19d5-4f35-8d32-330e940031b7 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 2G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-613b2e80-19d5-4f35-8d32-330e940031b7 tempest-VolumesExtendTest-986821320 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 2G" returned: 0 in 0.066s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-613b2e80-19d5-4f35-8d32-330e940031b7 tempest-VolumesExtendTest-986821320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.811s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:05 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-613b2e80-19d5-4f35-8d32-330e940031b7 tempest-VolumesExtendTest-986821320 None] Extend volume completed successfully. Jun 30 16:19:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2c0eff43-d59d-4d50-afc1-2eb4a036f307 tempest-VolumesExtendTest-986821320 None] Acquiring lock "cinder-71ab2229-1fe9-43a7-b64f-623dba584b68-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2c0eff43-d59d-4d50-afc1-2eb4a036f307 tempest-VolumesExtendTest-986821320 None] Lock "cinder-71ab2229-1fe9-43a7-b64f-623dba584b68-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2c0eff43-d59d-4d50-afc1-2eb4a036f307 tempest-VolumesExtendTest-986821320 None] Acquiring lock "cinder-quobyte-71ab2229-1fe9-43a7-b64f-623dba584b68" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2c0eff43-d59d-4d50-afc1-2eb4a036f307 tempest-VolumesExtendTest-986821320 None] Lock "cinder-quobyte-71ab2229-1fe9-43a7-b64f-623dba584b68" acquired by "delete_volume" :: waited 0.015s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:06 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[69955f19-c074-4047-8960-dbd8540df5d9]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:19:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2c0eff43-d59d-4d50-afc1-2eb4a036f307 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:06 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 Jun 30 16:19:06 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:06 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:19:06 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Flow 'volume_create_manager' (11c91f7b-3bc2-44a4-961d-81938f678d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:19:06 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed0a62a-944a-4ba4-803b-e373d0ca80df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:06 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed0a62a-944a-4ba4-803b-e373d0ca80df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1275177308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14727961-3cd5-4f3e-8c55-6282b147487e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a0c6d96f384c46bd285645f2c2934c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:19:07Z,use_quota=True,user_id='d1e0e9fa4d774db4876a3d13aa8b4425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:06 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e01fc7-7d1f-4770-bcb9-b8ad89f5bdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e01fc7-7d1f-4770-bcb9-b8ad89f5bdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1224f65a-5d60-46b8-8028-390642546426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1224f65a-5d60-46b8-8028-390642546426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14727961-3cd5-4f3e-8c55-6282b147487e', 'volume_name': 'volume-14727961-3cd5-4f3e-8c55-6282b147487e', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0529645-15bc-401a-a7c8-81eab2f6898e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0529645-15bc-401a-a7c8-81eab2f6898e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432fa608-5499-4920-ab58-e8dd147251e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:07 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Volume 14727961-3cd5-4f3e-8c55-6282b147487e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14727961-3cd5-4f3e-8c55-6282b147487e', 'volume_size': 1} Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1275177308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14727961-3cd5-4f3e-8c55-6282b147487e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a0c6d96f384c46bd285645f2c2934c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:19:07Z,use_quota=True,user_id='d1e0e9fa4d774db4876a3d13aa8b4425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Creating volume 14727961-3cd5-4f3e-8c55-6282b147487e {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:19:07 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-14727961-3cd5-4f3e-8c55-6282b147487e 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:07 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2c0eff43-d59d-4d50-afc1-2eb4a036f307 tempest-VolumesExtendTest-986821320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68" returned: 0 in 0.809s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2c0eff43-d59d-4d50-afc1-2eb4a036f307 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:07 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-14727961-3cd5-4f3e-8c55-6282b147487e 1073741824 Jun 30 16:19:07 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:07 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 Jun 30 16:19:07 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2c0eff43-d59d-4d50-afc1-2eb4a036f307 tempest-VolumesExtendTest-986821320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68" returned: 1 in 0.744s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2c0eff43-d59d-4d50-afc1-2eb4a036f307 tempest-VolumesExtendTest-986821320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:19:07 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2c0eff43-d59d-4d50-afc1-2eb4a036f307 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:07 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68 Jun 30 16:19:07 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:07 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-14727961-3cd5-4f3e-8c55-6282b147487e 1073741824" returned: 0 in 0.871s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-14727961-3cd5-4f3e-8c55-6282b147487e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:07 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-14727961-3cd5-4f3e-8c55-6282b147487e Jun 30 16:19:07 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:08 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2c0eff43-d59d-4d50-afc1-2eb4a036f307 tempest-VolumesExtendTest-986821320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-71ab2229-1fe9-43a7-b64f-623dba584b68" returned: 0 in 0.677s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:08 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2c0eff43-d59d-4d50-afc1-2eb4a036f307 tempest-VolumesExtendTest-986821320 None] Lock "cinder-quobyte-71ab2229-1fe9-43a7-b64f-623dba584b68" released by "delete_volume" :: held 2.305s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:19:08 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-2c0eff43-d59d-4d50-afc1-2eb4a036f307 tempest-VolumesExtendTest-986821320 None] Created reservations ['c00e7612-b85e-48c5-95fe-3cf89583aa0c', 'cfb3f4dd-740b-411b-841d-99fa42a13c87', '8549a147-d0c4-4055-a28d-3063dcaea884', '013fb859-c6fe-4a33-9d16-b8394ca67334'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:19:08 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-14727961-3cd5-4f3e-8c55-6282b147487e" returned: 0 in 0.646s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:19:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2c0eff43-d59d-4d50-afc1-2eb4a036f307 tempest-VolumesExtendTest-986821320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2c0eff43-d59d-4d50-afc1-2eb4a036f307 tempest-VolumesExtendTest-986821320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-2c0eff43-d59d-4d50-afc1-2eb4a036f307 tempest-VolumesExtendTest-986821320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:19:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-2c0eff43-d59d-4d50-afc1-2eb4a036f307 tempest-VolumesExtendTest-986821320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:19:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2c0eff43-d59d-4d50-afc1-2eb4a036f307 tempest-VolumesExtendTest-986821320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2c0eff43-d59d-4d50-afc1-2eb4a036f307 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432fa608-5499-4920-ab58-e8dd147251e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14727961-3cd5-4f3e-8c55-6282b147487e', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e7c30f8-2d76-4fd3-a4fc-9c368bd80a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:08 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:19:08 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:08 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Volume volume-14727961-3cd5-4f3e-8c55-6282b147487e (14727961-3cd5-4f3e-8c55-6282b147487e): created successfully Jun 30 16:19:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e7c30f8-2d76-4fd3-a4fc-9c368bd80a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Flow 'volume_create_manager' (11c91f7b-3bc2-44a4-961d-81938f678d5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:19:08 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-1d070b92-0916-4844-8a6b-f7063f40d868 tempest-AbsoluteLimitsTests-1005835227 None] Created volume successfully. Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8a58e098-8609-4fab-98ca-0fb8674ce70b tempest-AbsoluteLimitsTests-1005835227 None] Acquiring lock "cinder-14727961-3cd5-4f3e-8c55-6282b147487e-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8a58e098-8609-4fab-98ca-0fb8674ce70b tempest-AbsoluteLimitsTests-1005835227 None] Lock "cinder-14727961-3cd5-4f3e-8c55-6282b147487e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8a58e098-8609-4fab-98ca-0fb8674ce70b tempest-AbsoluteLimitsTests-1005835227 None] Acquiring lock "cinder-quobyte-14727961-3cd5-4f3e-8c55-6282b147487e" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8a58e098-8609-4fab-98ca-0fb8674ce70b tempest-AbsoluteLimitsTests-1005835227 None] Lock "cinder-quobyte-14727961-3cd5-4f3e-8c55-6282b147487e" acquired by "delete_volume" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c00b0cb-60c6-4a94-8f1b-4c19833727a2]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8a58e098-8609-4fab-98ca-0fb8674ce70b tempest-AbsoluteLimitsTests-1005835227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-14727961-3cd5-4f3e-8c55-6282b147487e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:09 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2c0eff43-d59d-4d50-afc1-2eb4a036f307 tempest-VolumesExtendTest-986821320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.637s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-2c0eff43-d59d-4d50-afc1-2eb4a036f307 tempest-VolumesExtendTest-986821320 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:19:09 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-2c0eff43-d59d-4d50-afc1-2eb4a036f307 tempest-VolumesExtendTest-986821320 None] Deleted volume successfully. Jun 30 16:19:09 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-14727961-3cd5-4f3e-8c55-6282b147487e Jun 30 16:19:09 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2c0eff43-d59d-4d50-afc1-2eb4a036f307 tempest-VolumesExtendTest-986821320 None] Lock "cinder-71ab2229-1fe9-43a7-b64f-623dba584b68-delete_volume" released by "delete_volume" :: held 3.169s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Flow 'volume_create_manager' (ac7814d0-a7ec-4d02-a19e-214156d6beb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faed5d31-dd72-48cf-a742-73fa3db10aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faed5d31-dd72-48cf-a742-73fa3db10aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-266226959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f7b5a339e34b31b677060b1b624dd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:19:10Z,use_quota=True,user_id='4a1ff57bbca74948b295cf65820b2189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bf8243-b8df-4e4d-a169-b87ffb0452b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bf8243-b8df-4e4d-a169-b87ffb0452b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759f8f05-ab81-4eac-9617-fdb2b603e326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759f8f05-ab81-4eac-9617-fdb2b603e326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3', 'volume_name': 'volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b5197fa-cd25-4325-9e17-1daceb4cb0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b5197fa-cd25-4325-9e17-1daceb4cb0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a04b21-53d1-4d50-8615-a869c89178aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:09 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Volume e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3', 'volume_size': 1} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-266226959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24f7b5a339e34b31b677060b1b624dd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:19:10Z,use_quota=True,user_id='4a1ff57bbca74948b295cf65820b2189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Creating volume e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:19:09 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:19:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:10 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3 1073741824 Jun 30 16:19:10 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:10 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8a58e098-8609-4fab-98ca-0fb8674ce70b tempest-AbsoluteLimitsTests-1005835227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-14727961-3cd5-4f3e-8c55-6282b147487e" returned: 0 in 0.827s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8a58e098-8609-4fab-98ca-0fb8674ce70b tempest-AbsoluteLimitsTests-1005835227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-14727961-3cd5-4f3e-8c55-6282b147487e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:10 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-14727961-3cd5-4f3e-8c55-6282b147487e Jun 30 16:19:10 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:10 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8a58e098-8609-4fab-98ca-0fb8674ce70b tempest-AbsoluteLimitsTests-1005835227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-14727961-3cd5-4f3e-8c55-6282b147487e" returned: 0 in 0.651s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:10 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8a58e098-8609-4fab-98ca-0fb8674ce70b tempest-AbsoluteLimitsTests-1005835227 None] Lock "cinder-quobyte-14727961-3cd5-4f3e-8c55-6282b147487e" released by "delete_volume" :: held 1.519s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:19:10 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-8a58e098-8609-4fab-98ca-0fb8674ce70b tempest-AbsoluteLimitsTests-1005835227 None] Created reservations ['abb58cf3-f60e-471d-bed2-fc62a62046b5', '711b88c2-e2c6-4a89-85d6-c4870182b46a', 'ca6b64f2-04f3-4091-9497-cbc23f325183', '3a2ef21e-b40f-4db1-9045-59846eb00418'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:19:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8a58e098-8609-4fab-98ca-0fb8674ce70b tempest-AbsoluteLimitsTests-1005835227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8a58e098-8609-4fab-98ca-0fb8674ce70b tempest-AbsoluteLimitsTests-1005835227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-8a58e098-8609-4fab-98ca-0fb8674ce70b tempest-AbsoluteLimitsTests-1005835227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:19:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-8a58e098-8609-4fab-98ca-0fb8674ce70b tempest-AbsoluteLimitsTests-1005835227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:19:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8a58e098-8609-4fab-98ca-0fb8674ce70b tempest-AbsoluteLimitsTests-1005835227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8a58e098-8609-4fab-98ca-0fb8674ce70b tempest-AbsoluteLimitsTests-1005835227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:10 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:19:10 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:10 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3 1073741824" returned: 0 in 0.875s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:10 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3 Jun 30 16:19:10 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:11 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8a58e098-8609-4fab-98ca-0fb8674ce70b tempest-AbsoluteLimitsTests-1005835227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.705s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:11 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-8a58e098-8609-4fab-98ca-0fb8674ce70b tempest-AbsoluteLimitsTests-1005835227 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:19:11 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-8a58e098-8609-4fab-98ca-0fb8674ce70b tempest-AbsoluteLimitsTests-1005835227 None] Deleted volume successfully. Jun 30 16:19:11 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8a58e098-8609-4fab-98ca-0fb8674ce70b tempest-AbsoluteLimitsTests-1005835227 None] Lock "cinder-14727961-3cd5-4f3e-8c55-6282b147487e-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:19:11 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3" returned: 0 in 0.691s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:11 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:19:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:11 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a04b21-53d1-4d50-8615-a869c89178aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:11 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be908cb1-35e4-4003-b696-ae8739040ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:11 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Volume volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3 (e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3): created successfully Jun 30 16:19:11 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be908cb1-35e4-4003-b696-ae8739040ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:11 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Flow 'volume_create_manager' (ac7814d0-a7ec-4d02-a19e-214156d6beb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:19:11 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-6311c70f-2193-4f5f-b972-c75ee1a09f79 tempest-VolumesExtendTest-986821320 None] Created volume successfully. Jun 30 16:19:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-84194fb9-8133-4664-bae4-717513d20026 tempest-VolumesExtendTest-986821320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-84194fb9-8133-4664-bae4-717513d20026 tempest-VolumesExtendTest-986821320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:12 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-84194fb9-8133-4664-bae4-717513d20026 tempest-VolumesExtendTest-986821320 None] Creating offline snapshot 1ce379b5-44aa-46d3-810e-59e411eb52c7 of volume e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3 {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:19:12 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fbcab6-b59e-4676-ab2a-9be2c012e97b]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:19:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-84194fb9-8133-4664-bae4-717513d20026 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:12 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3 Jun 30 16:19:12 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:13 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-84194fb9-8133-4664-bae4-717513d20026 tempest-VolumesExtendTest-986821320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3" returned: 0 in 0.798s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-84194fb9-8133-4664-bae4-717513d20026 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.1ce379b5-44aa-46d3-810e-59e411eb52c7 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:13 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.1ce379b5-44aa-46d3-810e-59e411eb52c7 1G Jun 30 16:19:13 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:13 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-84194fb9-8133-4664-bae4-717513d20026 tempest-VolumesExtendTest-986821320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.1ce379b5-44aa-46d3-810e-59e411eb52c7 1G" returned: 0 in 0.942s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-84194fb9-8133-4664-bae4-717513d20026 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.1ce379b5-44aa-46d3-810e-59e411eb52c7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:14 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.1ce379b5-44aa-46d3-810e-59e411eb52c7 Jun 30 16:19:14 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:14 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-84194fb9-8133-4664-bae4-717513d20026 tempest-VolumesExtendTest-986821320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.1ce379b5-44aa-46d3-810e-59e411eb52c7" returned: 0 in 0.778s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:14 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-84194fb9-8133-4664-bae4-717513d20026 tempest-VolumesExtendTest-986821320 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.1ce379b5-44aa-46d3-810e-59e411eb52c7 is being set with open permissions: ugo+rw Jun 30 16:19:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-84194fb9-8133-4664-bae4-717513d20026 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.1ce379b5-44aa-46d3-810e-59e411eb52c7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:14 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.1ce379b5-44aa-46d3-810e-59e411eb52c7 Jun 30 16:19:14 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:15 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-84194fb9-8133-4664-bae4-717513d20026 tempest-VolumesExtendTest-986821320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.1ce379b5-44aa-46d3-810e-59e411eb52c7" returned: 0 in 0.693s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-84194fb9-8133-4664-bae4-717513d20026 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:15 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.info Jun 30 16:19:15 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:15 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:19:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Flow 'volume_create_manager' (bc7c9b2c-1e67-4143-828f-f168ca63dab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:19:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d910133-e8b2-4eed-a572-af3a6cc1c786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d910133-e8b2-4eed-a572-af3a6cc1c786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1966428734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6100583c-3358-4f07-9bb1-d831bded6a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0bab92c02b94747abff8387833df65a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:19:16Z,use_quota=True,user_id='405eb386f1074d9285bb65c0f6f663fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcdfd11a-759f-42ba-9104-04f2cc7c9e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcdfd11a-759f-42ba-9104-04f2cc7c9e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce57864-335d-4225-b906-395971edf0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce57864-335d-4225-b906-395971edf0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6100583c-3358-4f07-9bb1-d831bded6a30', 'volume_name': 'volume-6100583c-3358-4f07-9bb1-d831bded6a30', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb9a498-80ca-4a5e-9fcd-44af780b9e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb9a498-80ca-4a5e-9fcd-44af780b9e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce88cf3-e5e7-4aa9-b9f7-1cbac6c81698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:15 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Volume 6100583c-3358-4f07-9bb1-d831bded6a30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6100583c-3358-4f07-9bb1-d831bded6a30', 'volume_size': 1} Jun 30 16:19:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:16 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-84194fb9-8133-4664-bae4-717513d20026 tempest-VolumesExtendTest-986821320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.info" returned: 0 in 0.646s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:16 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-84194fb9-8133-4664-bae4-717513d20026 tempest-VolumesExtendTest-986821320 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.info is being set with open permissions: ugo+rw Jun 30 16:19:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-84194fb9-8133-4664-bae4-717513d20026 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:16 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.info Jun 30 16:19:16 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:16 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-84194fb9-8133-4664-bae4-717513d20026 tempest-VolumesExtendTest-986821320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.info" returned: 0 in 0.726s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-84194fb9-8133-4664-bae4-717513d20026 tempest-VolumesExtendTest-986821320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.681s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.064s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:16 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1966428734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6100583c-3358-4f07-9bb1-d831bded6a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0bab92c02b94747abff8387833df65a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:19:16Z,use_quota=True,user_id='405eb386f1074d9285bb65c0f6f663fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:19:16 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Creating volume 6100583c-3358-4f07-9bb1-d831bded6a30 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:19:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:16 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:19:16 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:19:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:16 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:19:16 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:19:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:16 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30 1073741824 Jun 30 16:19:16 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:16 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-84194fb9-8133-4664-bae4-717513d20026 tempest-VolumesExtendTest-986821320 None] Create snapshot completed successfully Jun 30 16:19:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cab2efe9-a97a-4826-96dc-fe7abfffb452 tempest-VolumesExtendTest-986821320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:17 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30 1073741824" returned: 0 in 0.927s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:17 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30 Jun 30 16:19:17 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:18 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30" returned: 0 in 0.693s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:18 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:19:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cab2efe9-a97a-4826-96dc-fe7abfffb452 tempest-VolumesExtendTest-986821320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.023s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:18 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4b6772-4500-423d-9a34-1a535b7b40e2]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:19:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cab2efe9-a97a-4826-96dc-fe7abfffb452 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce88cf3-e5e7-4aa9-b9f7-1cbac6c81698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6100583c-3358-4f07-9bb1-d831bded6a30', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d776e147-db9d-4039-aff2-949128457d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:18 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Volume volume-6100583c-3358-4f07-9bb1-d831bded6a30 (6100583c-3358-4f07-9bb1-d831bded6a30): created successfully Jun 30 16:19:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d776e147-db9d-4039-aff2-949128457d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Flow 'volume_create_manager' (bc7c9b2c-1e67-4143-828f-f168ca63dab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:19:18 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-c6aeacaf-ed63-4fc3-bc26-6f487dca5d38 tempest-VolumesDeleteCascade-2018007775 None] Created volume successfully. Jun 30 16:19:18 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3 Jun 30 16:19:18 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-186073cf-bacf-4049-ac3f-556418b4e45c tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:19 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cab2efe9-a97a-4826-96dc-fe7abfffb452 tempest-VolumesExtendTest-986821320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3" returned: 0 in 0.825s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cab2efe9-a97a-4826-96dc-fe7abfffb452 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.1ce379b5-44aa-46d3-810e-59e411eb52c7 2G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cab2efe9-a97a-4826-96dc-fe7abfffb452 tempest-VolumesExtendTest-986821320 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.1ce379b5-44aa-46d3-810e-59e411eb52c7 2G" returned: 0 in 0.178s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cab2efe9-a97a-4826-96dc-fe7abfffb452 tempest-VolumesExtendTest-986821320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.051s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-186073cf-bacf-4049-ac3f-556418b4e45c tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.533s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-186073cf-bacf-4049-ac3f-556418b4e45c tempest-VolumesDeleteCascade-2018007775 None] Creating offline snapshot c4866f0d-feaa-4794-9019-a5332edfea92 of volume 6100583c-3358-4f07-9bb1-d831bded6a30 {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:19:19 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0165f7-f523-4a0f-a05f-b80105a50f59]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:19:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-186073cf-bacf-4049-ac3f-556418b4e45c tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:19 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-cab2efe9-a97a-4826-96dc-fe7abfffb452 tempest-VolumesExtendTest-986821320 None] Extend volume completed successfully. Jun 30 16:19:19 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30 Jun 30 16:19:19 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:20 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-186073cf-bacf-4049-ac3f-556418b4e45c tempest-VolumesDeleteCascade-2018007775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30" returned: 0 in 0.833s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-186073cf-bacf-4049-ac3f-556418b4e45c tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:20 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92 1G Jun 30 16:19:20 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1a62d206-8890-4801-9c1a-92e26173118c tempest-VolumesExtendTest-986821320 None] Acquiring lock "cinder-1ce379b5-44aa-46d3-810e-59e411eb52c7-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1a62d206-8890-4801-9c1a-92e26173118c tempest-VolumesExtendTest-986821320 None] Lock "cinder-1ce379b5-44aa-46d3-810e-59e411eb52c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1a62d206-8890-4801-9c1a-92e26173118c tempest-VolumesExtendTest-986821320 None] Acquiring lock "cinder-quobyte-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1a62d206-8890-4801-9c1a-92e26173118c tempest-VolumesExtendTest-986821320 None] Lock "cinder-quobyte-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1a62d206-8890-4801-9c1a-92e26173118c tempest-VolumesExtendTest-986821320 None] Acquiring lock "cinder-quobyte-1ce379b5-44aa-46d3-810e-59e411eb52c7" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1a62d206-8890-4801-9c1a-92e26173118c tempest-VolumesExtendTest-986821320 None] Lock "cinder-quobyte-1ce379b5-44aa-46d3-810e-59e411eb52c7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-1a62d206-8890-4801-9c1a-92e26173118c tempest-VolumesExtendTest-986821320 None] Deleting offline snapshot 1ce379b5-44aa-46d3-810e-59e411eb52c7 of volume e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:19:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-1a62d206-8890-4801-9c1a-92e26173118c tempest-VolumesExtendTest-986821320 None] snapshot_file for this snap is: volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.1ce379b5-44aa-46d3-810e-59e411eb52c7 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:19:21 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[f854d640-0b74-4cb6-82a1-ffe6c1ad4579]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:19:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1a62d206-8890-4801-9c1a-92e26173118c tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.1ce379b5-44aa-46d3-810e-59e411eb52c7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:21 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.1ce379b5-44aa-46d3-810e-59e411eb52c7 Jun 30 16:19:21 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:21 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-186073cf-bacf-4049-ac3f-556418b4e45c tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92 1G" returned: 0 in 0.880s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-186073cf-bacf-4049-ac3f-556418b4e45c tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6100583c-3358-4f07-9bb1-d831bded6a30 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:21 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6100583c-3358-4f07-9bb1-d831bded6a30 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92 Jun 30 16:19:21 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:21 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1a62d206-8890-4801-9c1a-92e26173118c tempest-VolumesExtendTest-986821320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.1ce379b5-44aa-46d3-810e-59e411eb52c7" returned: 0 in 0.887s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-1a62d206-8890-4801-9c1a-92e26173118c tempest-VolumesExtendTest-986821320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:19:21 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[96523780-b513-4e0a-9fa0-32cd83fc7e7d]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:19:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1a62d206-8890-4801-9c1a-92e26173118c tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:22 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3 Jun 30 16:19:22 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:22 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-186073cf-bacf-4049-ac3f-556418b4e45c tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6100583c-3358-4f07-9bb1-d831bded6a30 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92" returned: 0 in 0.759s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:22 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-186073cf-bacf-4049-ac3f-556418b4e45c tempest-VolumesDeleteCascade-2018007775 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92 is being set with open permissions: ugo+rw Jun 30 16:19:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-186073cf-bacf-4049-ac3f-556418b4e45c tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:22 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92 Jun 30 16:19:22 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:22 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1a62d206-8890-4801-9c1a-92e26173118c tempest-VolumesExtendTest-986821320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3" returned: 0 in 0.841s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1a62d206-8890-4801-9c1a-92e26173118c tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.1ce379b5-44aa-46d3-810e-59e411eb52c7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:22 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-186073cf-bacf-4049-ac3f-556418b4e45c tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92" returned: 0 in 0.709s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:22 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.1ce379b5-44aa-46d3-810e-59e411eb52c7 Jun 30 16:19:22 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-186073cf-bacf-4049-ac3f-556418b4e45c tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:22 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.info Jun 30 16:19:22 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:23 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-186073cf-bacf-4049-ac3f-556418b4e45c tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.info" returned: 0 in 0.705s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:23 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-186073cf-bacf-4049-ac3f-556418b4e45c tempest-VolumesDeleteCascade-2018007775 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.info is being set with open permissions: ugo+rw Jun 30 16:19:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-186073cf-bacf-4049-ac3f-556418b4e45c tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:23 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.info Jun 30 16:19:23 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:23 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1a62d206-8890-4801-9c1a-92e26173118c tempest-VolumesExtendTest-986821320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.1ce379b5-44aa-46d3-810e-59e411eb52c7" returned: 0 in 0.885s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1a62d206-8890-4801-9c1a-92e26173118c tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.1ce379b5-44aa-46d3-810e-59e411eb52c7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:23 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.1ce379b5-44aa-46d3-810e-59e411eb52c7 Jun 30 16:19:23 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:24 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-186073cf-bacf-4049-ac3f-556418b4e45c tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.info" returned: 0 in 0.726s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-186073cf-bacf-4049-ac3f-556418b4e45c tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.733s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:24 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-186073cf-bacf-4049-ac3f-556418b4e45c tempest-VolumesDeleteCascade-2018007775 None] Create snapshot completed successfully Jun 30 16:19:24 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1a62d206-8890-4801-9c1a-92e26173118c tempest-VolumesExtendTest-986821320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3.1ce379b5-44aa-46d3-810e-59e411eb52c7" returned: 0 in 0.724s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:24 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1a62d206-8890-4801-9c1a-92e26173118c tempest-VolumesExtendTest-986821320 None] Lock "cinder-quobyte-1ce379b5-44aa-46d3-810e-59e411eb52c7" released by "_delete_snapshot" :: held 3.465s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:19:24 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1a62d206-8890-4801-9c1a-92e26173118c tempest-VolumesExtendTest-986821320 None] Lock "cinder-quobyte-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3" released by "delete_snapshot" :: held 3.490s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:19:24 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-1a62d206-8890-4801-9c1a-92e26173118c tempest-VolumesExtendTest-986821320 None] Created reservations ['22fd247c-943e-4cca-87ce-4c9fd8e77636', '3d5025ff-3a6c-4e51-8ab7-1ca2dc0f2844', 'f061b0ae-3dbc-482c-99dd-b977f7b59b6c', 'beda2b48-e51c-4585-bc62-5fb42ca3afb8'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:19:24 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-1a62d206-8890-4801-9c1a-92e26173118c tempest-VolumesExtendTest-986821320 None] Delete snapshot completed successfully. Jun 30 16:19:24 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1a62d206-8890-4801-9c1a-92e26173118c tempest-VolumesExtendTest-986821320 None] Lock "cinder-1ce379b5-44aa-46d3-810e-59e411eb52c7-delete_snapshot" released by "delete_snapshot" :: held 3.659s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:19:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-851ff4d2-dc30-4007-b3c2-79d0a3498356 tempest-VolumesExtendTest-986821320 None] Acquiring lock "cinder-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-851ff4d2-dc30-4007-b3c2-79d0a3498356 tempest-VolumesExtendTest-986821320 None] Lock "cinder-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-851ff4d2-dc30-4007-b3c2-79d0a3498356 tempest-VolumesExtendTest-986821320 None] Acquiring lock "cinder-quobyte-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-851ff4d2-dc30-4007-b3c2-79d0a3498356 tempest-VolumesExtendTest-986821320 None] Lock "cinder-quobyte-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3" acquired by "delete_volume" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:25 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e00fba-726d-496c-9f43-02cd2bcdc115]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:19:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-851ff4d2-dc30-4007-b3c2-79d0a3498356 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-daff31a4-7338-447c-a2df-e1aa2d2940b4 tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-daff31a4-7338-447c-a2df-e1aa2d2940b4 tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-daff31a4-7338-447c-a2df-e1aa2d2940b4 tempest-VolumesDeleteCascade-2018007775 None] Creating offline snapshot 7cb40aaf-b7dc-4e68-b208-9a91fa988a03 of volume 6100583c-3358-4f07-9bb1-d831bded6a30 {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:19:25 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3 Jun 30 16:19:25 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:25 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a31f492-de48-4d92-9cbe-68a2dc24f834]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:19:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-daff31a4-7338-447c-a2df-e1aa2d2940b4 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:25 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92 Jun 30 16:19:25 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:26 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-851ff4d2-dc30-4007-b3c2-79d0a3498356 tempest-VolumesExtendTest-986821320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3" returned: 0 in 0.898s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-851ff4d2-dc30-4007-b3c2-79d0a3498356 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:26 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3 Jun 30 16:19:26 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:26 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-daff31a4-7338-447c-a2df-e1aa2d2940b4 tempest-VolumesDeleteCascade-2018007775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92" returned: 0 in 0.878s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:26 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-daff31a4-7338-447c-a2df-e1aa2d2940b4 tempest-VolumesDeleteCascade-2018007775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6100583c-3358-4f07-9bb1-d831bded6a30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:19:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-daff31a4-7338-447c-a2df-e1aa2d2940b4 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.7cb40aaf-b7dc-4e68-b208-9a91fa988a03 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:26 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.7cb40aaf-b7dc-4e68-b208-9a91fa988a03 1G Jun 30 16:19:26 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:27 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-851ff4d2-dc30-4007-b3c2-79d0a3498356 tempest-VolumesExtendTest-986821320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3" returned: 0 in 0.771s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:27 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-851ff4d2-dc30-4007-b3c2-79d0a3498356 tempest-VolumesExtendTest-986821320 None] Lock "cinder-quobyte-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3" released by "delete_volume" :: held 1.759s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:19:27 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-851ff4d2-dc30-4007-b3c2-79d0a3498356 tempest-VolumesExtendTest-986821320 None] Created reservations ['53af2f14-286c-4773-82ab-cabb65c00c04', '42d2e715-96d8-46fd-a7ed-837c49c7745c', 'f5a7b258-ed94-4d17-99ac-c4c4d984004d', '73e0a242-4fd7-48c4-9ec5-dd47baca5cfe'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:19:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-851ff4d2-dc30-4007-b3c2-79d0a3498356 tempest-VolumesExtendTest-986821320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-851ff4d2-dc30-4007-b3c2-79d0a3498356 tempest-VolumesExtendTest-986821320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:27 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-851ff4d2-dc30-4007-b3c2-79d0a3498356 tempest-VolumesExtendTest-986821320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:19:27 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-851ff4d2-dc30-4007-b3c2-79d0a3498356 tempest-VolumesExtendTest-986821320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:19:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-851ff4d2-dc30-4007-b3c2-79d0a3498356 tempest-VolumesExtendTest-986821320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-851ff4d2-dc30-4007-b3c2-79d0a3498356 tempest-VolumesExtendTest-986821320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:27 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:19:27 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:27 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-daff31a4-7338-447c-a2df-e1aa2d2940b4 tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.7cb40aaf-b7dc-4e68-b208-9a91fa988a03 1G" returned: 0 in 0.910s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-daff31a4-7338-447c-a2df-e1aa2d2940b4 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.7cb40aaf-b7dc-4e68-b208-9a91fa988a03 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:27 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.7cb40aaf-b7dc-4e68-b208-9a91fa988a03 Jun 30 16:19:27 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:28 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-851ff4d2-dc30-4007-b3c2-79d0a3498356 tempest-VolumesExtendTest-986821320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.808s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:28 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-851ff4d2-dc30-4007-b3c2-79d0a3498356 tempest-VolumesExtendTest-986821320 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:19:28 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-851ff4d2-dc30-4007-b3c2-79d0a3498356 tempest-VolumesExtendTest-986821320 None] Deleted volume successfully. Jun 30 16:19:28 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-851ff4d2-dc30-4007-b3c2-79d0a3498356 tempest-VolumesExtendTest-986821320 None] Lock "cinder-e4b132e2-2230-42d9-a2e5-a55b6cbf3ad3-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:19:28 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-daff31a4-7338-447c-a2df-e1aa2d2940b4 tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.7cb40aaf-b7dc-4e68-b208-9a91fa988a03" returned: 0 in 0.823s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:28 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-daff31a4-7338-447c-a2df-e1aa2d2940b4 tempest-VolumesDeleteCascade-2018007775 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.7cb40aaf-b7dc-4e68-b208-9a91fa988a03 is being set with open permissions: ugo+rw Jun 30 16:19:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-daff31a4-7338-447c-a2df-e1aa2d2940b4 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.7cb40aaf-b7dc-4e68-b208-9a91fa988a03 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:28 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.7cb40aaf-b7dc-4e68-b208-9a91fa988a03 Jun 30 16:19:28 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:29 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-daff31a4-7338-447c-a2df-e1aa2d2940b4 tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.7cb40aaf-b7dc-4e68-b208-9a91fa988a03" returned: 0 in 0.854s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-daff31a4-7338-447c-a2df-e1aa2d2940b4 tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.596s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:29 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-daff31a4-7338-447c-a2df-e1aa2d2940b4 tempest-VolumesDeleteCascade-2018007775 None] Create snapshot completed successfully Jun 30 16:19:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "cinder-6100583c-3358-4f07-9bb1-d831bded6a30-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-6100583c-3358-4f07-9bb1-d831bded6a30-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Performing cascade delete. {{(pid=93781) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 30 16:19:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "cinder-7cb40aaf-b7dc-4e68-b208-9a91fa988a03-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-7cb40aaf-b7dc-4e68-b208-9a91fa988a03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "cinder-quobyte-6100583c-3358-4f07-9bb1-d831bded6a30" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:30 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-quobyte-6100583c-3358-4f07-9bb1-d831bded6a30" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:30 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "cinder-quobyte-7cb40aaf-b7dc-4e68-b208-9a91fa988a03" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:30 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-quobyte-7cb40aaf-b7dc-4e68-b208-9a91fa988a03" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Deleting offline snapshot 7cb40aaf-b7dc-4e68-b208-9a91fa988a03 of volume 6100583c-3358-4f07-9bb1-d831bded6a30 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:19:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] snapshot_file for this snap is: volume-6100583c-3358-4f07-9bb1-d831bded6a30.7cb40aaf-b7dc-4e68-b208-9a91fa988a03 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:19:30 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5daaed9-838a-4867-a95e-0fa50d2e492b]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:19:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.7cb40aaf-b7dc-4e68-b208-9a91fa988a03 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:30 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.7cb40aaf-b7dc-4e68-b208-9a91fa988a03 Jun 30 16:19:30 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:30 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.7cb40aaf-b7dc-4e68-b208-9a91fa988a03" returned: 0 in 0.801s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6100583c-3358-4f07-9bb1-d831bded6a30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:19:30 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d82aedf-f4c9-4b7f-947a-a515646797b3]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:19:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:31 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92 Jun 30 16:19:31 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:31 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92" returned: 0 in 0.856s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6100583c-3358-4f07-9bb1-d831bded6a30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:19:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.7cb40aaf-b7dc-4e68-b208-9a91fa988a03 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:31 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.7cb40aaf-b7dc-4e68-b208-9a91fa988a03 Jun 30 16:19:31 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:32 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.7cb40aaf-b7dc-4e68-b208-9a91fa988a03" returned: 0 in 0.837s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.7cb40aaf-b7dc-4e68-b208-9a91fa988a03 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:32 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.7cb40aaf-b7dc-4e68-b208-9a91fa988a03 Jun 30 16:19:32 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:33 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:19:33 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:33 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.7cb40aaf-b7dc-4e68-b208-9a91fa988a03" returned: 0 in 0.677s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-quobyte-7cb40aaf-b7dc-4e68-b208-9a91fa988a03" released by "_delete_snapshot" :: held 3.286s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-quobyte-6100583c-3358-4f07-9bb1-d831bded6a30" released by "delete_snapshot" :: held 3.307s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=117,cinder:UPDATE=122,cinder:INSERT=37,cinder:DELETE=14 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Created reservations ['61f32171-b8b9-4184-bdd8-d202f6844938', '698f2a28-bd5b-4f3a-be82-347214831fe5', '7ac1955d-0a9f-42af-ae5a-f4a869015345', '71c933c7-c3e9-405c-86da-9f9056732ef5'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:19:33 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Delete snapshot completed successfully. Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-7cb40aaf-b7dc-4e68-b208-9a91fa988a03-delete_snapshot" released by "delete_snapshot" :: held 3.509s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "cinder-c4866f0d-feaa-4794-9019-a5332edfea92-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-c4866f0d-feaa-4794-9019-a5332edfea92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "cinder-quobyte-6100583c-3358-4f07-9bb1-d831bded6a30" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-quobyte-6100583c-3358-4f07-9bb1-d831bded6a30" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "cinder-quobyte-c4866f0d-feaa-4794-9019-a5332edfea92" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-quobyte-c4866f0d-feaa-4794-9019-a5332edfea92" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Deleting offline snapshot c4866f0d-feaa-4794-9019-a5332edfea92 of volume 6100583c-3358-4f07-9bb1-d831bded6a30 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] snapshot_file for this snap is: volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f89a177-fc7a-425e-b565-b78f33bd086b]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:33 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92 Jun 30 16:19:33 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:33 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.765s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 28 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:19:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:19:34 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92" returned: 0 in 0.872s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6100583c-3358-4f07-9bb1-d831bded6a30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:19:34 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f31948f-85e2-4a06-89b1-50a5d2e0f236]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:19:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:34 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30 Jun 30 16:19:34 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:35 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30" returned: 0 in 0.945s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:35 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92 Jun 30 16:19:35 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:36 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92" returned: 0 in 0.813s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:36 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92 Jun 30 16:19:36 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:37 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30.c4866f0d-feaa-4794-9019-a5332edfea92" returned: 0 in 0.735s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:37 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-quobyte-c4866f0d-feaa-4794-9019-a5332edfea92" released by "_delete_snapshot" :: held 3.477s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:19:37 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-quobyte-6100583c-3358-4f07-9bb1-d831bded6a30" released by "delete_snapshot" :: held 3.510s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:19:37 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Created reservations ['92002164-8cd9-49ed-b4fa-add3ac96c8ba', '0c8a2740-ca87-413d-a93a-8b6ea798df8c', '1e8308a5-9623-4da7-b8b1-e7d5d82a098c', '8a875c1f-34be-4ff1-8aea-361906e21db2'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:19:37 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Delete snapshot completed successfully. Jun 30 16:19:37 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-c4866f0d-feaa-4794-9019-a5332edfea92-delete_snapshot" released by "delete_snapshot" :: held 3.684s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:19:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Snapshots deleted, issuing volume delete {{(pid=93781) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 30 16:19:37 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "cinder-quobyte-6100583c-3358-4f07-9bb1-d831bded6a30" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:37 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-quobyte-6100583c-3358-4f07-9bb1-d831bded6a30" acquired by "delete_volume" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:37 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[0feb3fa6-6ffa-4108-80ab-f5c9e00a4723]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:19:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:37 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30 Jun 30 16:19:37 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:38 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30" returned: 0 in 0.879s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:38 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30 Jun 30 16:19:38 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:38 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-6100583c-3358-4f07-9bb1-d831bded6a30" returned: 0 in 0.812s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-quobyte-6100583c-3358-4f07-9bb1-d831bded6a30" released by "delete_volume" :: held 1.801s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Created reservations ['20f100c1-225e-4dbf-8b7c-8149d7f3eea9', '61ad4d81-0cf7-4003-80f9-03d0d8d5cf12', '892f80fd-b35e-4457-accf-317de88a3341', 'a4fb8b70-bdf6-4ed9-b3a1-ba1d5eeab68c'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:39 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:19:39 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Flow 'volume_create_manager' (f1c36507-e1b7-4162-ae0a-bf0bfa823e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c920ec36-5acf-4486-ac9b-c6cc90bb00b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c920ec36-5acf-4486-ac9b-c6cc90bb00b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-155288158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222e5cae-e4ce-4842-979a-956f5c79288a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84840f58dc3f4285853db090b3507452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:19:39Z,use_quota=True,user_id='7592a53d4232498ca6082ced67456e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2636cdc-df17-4157-a2a4-8ff088201075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2636cdc-df17-4157-a2a4-8ff088201075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eaaa195-bbc3-42ef-a25f-9936703aaeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eaaa195-bbc3-42ef-a25f-9936703aaeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '222e5cae-e4ce-4842-979a-956f5c79288a', 'volume_name': 'volume-222e5cae-e4ce-4842-979a-956f5c79288a', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (973c414a-5684-4b36-b615-428e8a734087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (973c414a-5684-4b36-b615-428e8a734087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1aa013-8647-4aec-a28b-f9c3fb9c1550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:39 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Volume 222e5cae-e4ce-4842-979a-956f5c79288a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-222e5cae-e4ce-4842-979a-956f5c79288a', 'volume_size': 1} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-155288158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222e5cae-e4ce-4842-979a-956f5c79288a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84840f58dc3f4285853db090b3507452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:19:39Z,use_quota=True,user_id='7592a53d4232498ca6082ced67456e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Creating volume 222e5cae-e4ce-4842-979a-956f5c79288a {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:19:39 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:39 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a 1073741824 Jun 30 16:19:39 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:39 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.732s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:19:39 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Deleted volume successfully. Jun 30 16:19:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8644aefd-6b5d-48f1-b4af-b13a60255029 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-6100583c-3358-4f07-9bb1-d831bded6a30-delete_volume" released by "delete_volume" :: held 10.054s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:19:40 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:19:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Flow 'volume_create_manager' (3804515c-7ef7-4756-8977-b6f09763ab59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:19:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (751edd54-8877-4565-81cd-afa7a189df44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (751edd54-8877-4565-81cd-afa7a189df44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1617373325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d821ba0-be8b-4aab-80f2-7be382214461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0bab92c02b94747abff8387833df65a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:19:40Z,use_quota=True,user_id='405eb386f1074d9285bb65c0f6f663fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd44f7b4-834b-4d8a-b26a-c00b341bbe2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd44f7b4-834b-4d8a-b26a-c00b341bbe2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af51114a-1eba-48db-9a90-0ae4173244ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af51114a-1eba-48db-9a90-0ae4173244ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d821ba0-be8b-4aab-80f2-7be382214461', 'volume_name': 'volume-9d821ba0-be8b-4aab-80f2-7be382214461', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26201196-6ee9-43d5-bd59-002009f67f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26201196-6ee9-43d5-bd59-002009f67f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e6ddfe-ee1b-43de-a079-07e66fad3fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:40 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Volume 9d821ba0-be8b-4aab-80f2-7be382214461: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d821ba0-be8b-4aab-80f2-7be382214461', 'volume_size': 1} Jun 30 16:19:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:40 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a 1073741824" returned: 0 in 0.949s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:40 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a Jun 30 16:19:40 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:41 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a" returned: 0 in 0.637s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:19:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.687s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1617373325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d821ba0-be8b-4aab-80f2-7be382214461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0bab92c02b94747abff8387833df65a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:19:40Z,use_quota=True,user_id='405eb386f1074d9285bb65c0f6f663fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:19:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Creating volume 9d821ba0-be8b-4aab-80f2-7be382214461 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:19:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:19:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:19:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:19:41 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:19:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:41 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461 1073741824 Jun 30 16:19:41 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:41 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1aa013-8647-4aec-a28b-f9c3fb9c1550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-222e5cae-e4ce-4842-979a-956f5c79288a', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:41 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907814a5-1191-43f9-aa4d-3df48d66d047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:41 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Volume volume-222e5cae-e4ce-4842-979a-956f5c79288a (222e5cae-e4ce-4842-979a-956f5c79288a): created successfully Jun 30 16:19:41 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907814a5-1191-43f9-aa4d-3df48d66d047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:41 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Flow 'volume_create_manager' (f1c36507-e1b7-4162-ae0a-bf0bfa823e73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:19:41 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-78cb6dfa-0bf9-4aca-b82b-16df4efb5e23 tempest-VolumesSnapshotTestJSON-1056995611 None] Created volume successfully. Jun 30 16:19:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-155b5e3a-4869-4505-a333-32651d81fde9 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:42 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461 1073741824" returned: 0 in 0.935s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:42 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461 Jun 30 16:19:42 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:42 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461" returned: 0 in 0.698s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:42 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:19:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-155b5e3a-4869-4505-a333-32651d81fde9 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.047s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:42 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e6ddfe-ee1b-43de-a079-07e66fad3fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d821ba0-be8b-4aab-80f2-7be382214461', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:42 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dfb36f3-2c1a-4bfe-a604-3c3304504c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:42 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-155b5e3a-4869-4505-a333-32651d81fde9 tempest-VolumesSnapshotTestJSON-1056995611 None] Creating offline snapshot 1a7e77ed-86cd-4e67-b6ba-7f935f52d767 of volume 222e5cae-e4ce-4842-979a-956f5c79288a {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:19:42 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Volume volume-9d821ba0-be8b-4aab-80f2-7be382214461 (9d821ba0-be8b-4aab-80f2-7be382214461): created successfully Jun 30 16:19:42 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dfb36f3-2c1a-4bfe-a604-3c3304504c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:42 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Flow 'volume_create_manager' (3804515c-7ef7-4756-8977-b6f09763ab59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:19:42 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e20c2e-88c2-4c41-8efc-ea9e708b34ef]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:19:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-155b5e3a-4869-4505-a333-32651d81fde9 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:42 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-0ab09fcb-90fc-4322-ac68-4c8d843dae7e tempest-VolumesDeleteCascade-2018007775 None] Created volume successfully. Jun 30 16:19:43 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a Jun 30 16:19:43 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-882a4644-6016-48b5-898f-527ca0561947 tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:43 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-155b5e3a-4869-4505-a333-32651d81fde9 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a" returned: 0 in 0.833s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-155b5e3a-4869-4505-a333-32651d81fde9 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.1a7e77ed-86cd-4e67-b6ba-7f935f52d767 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:43 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.1a7e77ed-86cd-4e67-b6ba-7f935f52d767 1G Jun 30 16:19:43 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:44 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-155b5e3a-4869-4505-a333-32651d81fde9 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.1a7e77ed-86cd-4e67-b6ba-7f935f52d767 1G" returned: 0 in 0.889s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-155b5e3a-4869-4505-a333-32651d81fde9 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-222e5cae-e4ce-4842-979a-956f5c79288a -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.1a7e77ed-86cd-4e67-b6ba-7f935f52d767 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:44 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-222e5cae-e4ce-4842-979a-956f5c79288a -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.1a7e77ed-86cd-4e67-b6ba-7f935f52d767 Jun 30 16:19:44 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:45 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-155b5e3a-4869-4505-a333-32651d81fde9 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-222e5cae-e4ce-4842-979a-956f5c79288a -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.1a7e77ed-86cd-4e67-b6ba-7f935f52d767" returned: 0 in 0.735s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:45 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-155b5e3a-4869-4505-a333-32651d81fde9 tempest-VolumesSnapshotTestJSON-1056995611 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.1a7e77ed-86cd-4e67-b6ba-7f935f52d767 is being set with open permissions: ugo+rw Jun 30 16:19:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-155b5e3a-4869-4505-a333-32651d81fde9 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.1a7e77ed-86cd-4e67-b6ba-7f935f52d767 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:45 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.1a7e77ed-86cd-4e67-b6ba-7f935f52d767 Jun 30 16:19:45 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:46 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-155b5e3a-4869-4505-a333-32651d81fde9 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.1a7e77ed-86cd-4e67-b6ba-7f935f52d767" returned: 0 in 0.682s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-155b5e3a-4869-4505-a333-32651d81fde9 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:46 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.info Jun 30 16:19:46 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:46 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-155b5e3a-4869-4505-a333-32651d81fde9 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.info" returned: 0 in 0.792s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:46 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-155b5e3a-4869-4505-a333-32651d81fde9 tempest-VolumesSnapshotTestJSON-1056995611 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.info is being set with open permissions: ugo+rw Jun 30 16:19:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-155b5e3a-4869-4505-a333-32651d81fde9 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:46 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.info Jun 30 16:19:46 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:47 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-155b5e3a-4869-4505-a333-32651d81fde9 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.info" returned: 0 in 0.645s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-155b5e3a-4869-4505-a333-32651d81fde9 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.711s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-882a4644-6016-48b5-898f-527ca0561947 tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.836s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-882a4644-6016-48b5-898f-527ca0561947 tempest-VolumesDeleteCascade-2018007775 None] Creating offline snapshot b5f8cb56-1209-42bb-825c-9a9d3d2da1ed of volume 9d821ba0-be8b-4aab-80f2-7be382214461 {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:19:47 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[95be2309-09f3-4326-9b78-b79f3efebeca]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:19:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-882a4644-6016-48b5-898f-527ca0561947 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:47 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-155b5e3a-4869-4505-a333-32651d81fde9 tempest-VolumesSnapshotTestJSON-1056995611 None] Create snapshot completed successfully Jun 30 16:19:47 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461 Jun 30 16:19:47 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-70d875b8-7d9f-4997-b836-31f02b31b348 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "cinder-1a7e77ed-86cd-4e67-b6ba-7f935f52d767-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-70d875b8-7d9f-4997-b836-31f02b31b348 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-1a7e77ed-86cd-4e67-b6ba-7f935f52d767-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-70d875b8-7d9f-4997-b836-31f02b31b348 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "cinder-quobyte-222e5cae-e4ce-4842-979a-956f5c79288a" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-70d875b8-7d9f-4997-b836-31f02b31b348 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-222e5cae-e4ce-4842-979a-956f5c79288a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-70d875b8-7d9f-4997-b836-31f02b31b348 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "cinder-quobyte-1a7e77ed-86cd-4e67-b6ba-7f935f52d767" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-70d875b8-7d9f-4997-b836-31f02b31b348 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-1a7e77ed-86cd-4e67-b6ba-7f935f52d767" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:48 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-70d875b8-7d9f-4997-b836-31f02b31b348 tempest-VolumesSnapshotTestJSON-1056995611 None] Deleting offline snapshot 1a7e77ed-86cd-4e67-b6ba-7f935f52d767 of volume 222e5cae-e4ce-4842-979a-956f5c79288a {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:19:48 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-70d875b8-7d9f-4997-b836-31f02b31b348 tempest-VolumesSnapshotTestJSON-1056995611 None] snapshot_file for this snap is: volume-222e5cae-e4ce-4842-979a-956f5c79288a.1a7e77ed-86cd-4e67-b6ba-7f935f52d767 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:19:48 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[5096acc6-e56a-481d-8441-d4c649223ed6]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:19:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-70d875b8-7d9f-4997-b836-31f02b31b348 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.1a7e77ed-86cd-4e67-b6ba-7f935f52d767 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:48 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-882a4644-6016-48b5-898f-527ca0561947 tempest-VolumesDeleteCascade-2018007775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461" returned: 0 in 0.865s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-882a4644-6016-48b5-898f-527ca0561947 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.b5f8cb56-1209-42bb-825c-9a9d3d2da1ed 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:48 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.b5f8cb56-1209-42bb-825c-9a9d3d2da1ed 1G Jun 30 16:19:48 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:48 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.1a7e77ed-86cd-4e67-b6ba-7f935f52d767 Jun 30 16:19:48 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:49 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-70d875b8-7d9f-4997-b836-31f02b31b348 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.1a7e77ed-86cd-4e67-b6ba-7f935f52d767" returned: 0 in 0.832s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-70d875b8-7d9f-4997-b836-31f02b31b348 tempest-VolumesSnapshotTestJSON-1056995611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-222e5cae-e4ce-4842-979a-956f5c79288a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:19:49 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cd12f6-0758-439d-aaf9-bb04c856b42a]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:19:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-70d875b8-7d9f-4997-b836-31f02b31b348 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:49 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-882a4644-6016-48b5-898f-527ca0561947 tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.b5f8cb56-1209-42bb-825c-9a9d3d2da1ed 1G" returned: 0 in 0.911s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-882a4644-6016-48b5-898f-527ca0561947 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d821ba0-be8b-4aab-80f2-7be382214461 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.b5f8cb56-1209-42bb-825c-9a9d3d2da1ed {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:49 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a Jun 30 16:19:49 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:49 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d821ba0-be8b-4aab-80f2-7be382214461 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.b5f8cb56-1209-42bb-825c-9a9d3d2da1ed Jun 30 16:19:49 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:50 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-70d875b8-7d9f-4997-b836-31f02b31b348 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a" returned: 0 in 0.803s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-70d875b8-7d9f-4997-b836-31f02b31b348 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.1a7e77ed-86cd-4e67-b6ba-7f935f52d767 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:50 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.1a7e77ed-86cd-4e67-b6ba-7f935f52d767 Jun 30 16:19:50 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:50 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-882a4644-6016-48b5-898f-527ca0561947 tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d821ba0-be8b-4aab-80f2-7be382214461 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.b5f8cb56-1209-42bb-825c-9a9d3d2da1ed" returned: 0 in 0.733s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:50 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-882a4644-6016-48b5-898f-527ca0561947 tempest-VolumesDeleteCascade-2018007775 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.b5f8cb56-1209-42bb-825c-9a9d3d2da1ed is being set with open permissions: ugo+rw Jun 30 16:19:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-882a4644-6016-48b5-898f-527ca0561947 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.b5f8cb56-1209-42bb-825c-9a9d3d2da1ed {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:50 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.b5f8cb56-1209-42bb-825c-9a9d3d2da1ed Jun 30 16:19:50 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:50 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-882a4644-6016-48b5-898f-527ca0561947 tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.b5f8cb56-1209-42bb-825c-9a9d3d2da1ed" returned: 0 in 0.703s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-882a4644-6016-48b5-898f-527ca0561947 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:50 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-70d875b8-7d9f-4997-b836-31f02b31b348 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.1a7e77ed-86cd-4e67-b6ba-7f935f52d767" returned: 0 in 0.810s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-70d875b8-7d9f-4997-b836-31f02b31b348 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.1a7e77ed-86cd-4e67-b6ba-7f935f52d767 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:50 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.info Jun 30 16:19:50 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:50 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.1a7e77ed-86cd-4e67-b6ba-7f935f52d767 Jun 30 16:19:50 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:51 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:51 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-70d875b8-7d9f-4997-b836-31f02b31b348 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a.1a7e77ed-86cd-4e67-b6ba-7f935f52d767" returned: 0 in 0.685s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-882a4644-6016-48b5-898f-527ca0561947 tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.info" returned: 0 in 0.718s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:51 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-882a4644-6016-48b5-898f-527ca0561947 tempest-VolumesDeleteCascade-2018007775 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.info is being set with open permissions: ugo+rw Jun 30 16:19:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-882a4644-6016-48b5-898f-527ca0561947 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:51 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.info Jun 30 16:19:51 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:51 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-70d875b8-7d9f-4997-b836-31f02b31b348 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-1a7e77ed-86cd-4e67-b6ba-7f935f52d767" released by "_delete_snapshot" :: held 3.271s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:19:51 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-70d875b8-7d9f-4997-b836-31f02b31b348 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-222e5cae-e4ce-4842-979a-956f5c79288a" released by "delete_snapshot" :: held 3.294s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:19:51 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-70d875b8-7d9f-4997-b836-31f02b31b348 tempest-VolumesSnapshotTestJSON-1056995611 None] Created reservations ['33caa621-724f-4746-be88-626ddb56d00b', '9db7017c-379b-4b1d-a7ec-c4cf715b1ebd', 'ce90c6e5-7672-4a73-8044-cad466daac0c', 'ec2de059-8ec7-4f58-8b4a-34870999ed55'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:19:51 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-70d875b8-7d9f-4997-b836-31f02b31b348 tempest-VolumesSnapshotTestJSON-1056995611 None] Delete snapshot completed successfully. Jun 30 16:19:51 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-70d875b8-7d9f-4997-b836-31f02b31b348 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-1a7e77ed-86cd-4e67-b6ba-7f935f52d767-delete_snapshot" released by "delete_snapshot" :: held 3.497s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:19:52 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-882a4644-6016-48b5-898f-527ca0561947 tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.info" returned: 0 in 0.662s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-882a4644-6016-48b5-898f-527ca0561947 tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.706s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:52 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-882a4644-6016-48b5-898f-527ca0561947 tempest-VolumesDeleteCascade-2018007775 None] Create snapshot completed successfully Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Flow 'volume_create_manager' (19838da8-82a4-4a9c-ab82-ce39b5627f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff67312-2262-4e5b-86bd-6154197a499a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff67312-2262-4e5b-86bd-6154197a499a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1629343597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40024e0e-9af0-4150-a5ce-792a697b79a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84840f58dc3f4285853db090b3507452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:19:53Z,use_quota=True,user_id='7592a53d4232498ca6082ced67456e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c36b506-0f8e-47f5-b90f-75ce99ecf1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c36b506-0f8e-47f5-b90f-75ce99ecf1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66ce35b-d61f-4861-9f85-6fa4a387ec20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66ce35b-d61f-4861-9f85-6fa4a387ec20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40024e0e-9af0-4150-a5ce-792a697b79a0', 'volume_name': 'volume-40024e0e-9af0-4150-a5ce-792a697b79a0', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa14c197-274f-4253-ab90-13d9fdc1c472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa14c197-274f-4253-ab90-13d9fdc1c472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c8adaf-fc11-4bc9-b59f-8739977e4f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:53 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Volume 40024e0e-9af0-4150-a5ce-792a697b79a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40024e0e-9af0-4150-a5ce-792a697b79a0', 'volume_size': 1} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1629343597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40024e0e-9af0-4150-a5ce-792a697b79a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84840f58dc3f4285853db090b3507452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:19:53Z,use_quota=True,user_id='7592a53d4232498ca6082ced67456e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Creating volume 40024e0e-9af0-4150-a5ce-792a697b79a0 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:19:53 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:53 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0 1073741824 Jun 30 16:19:53 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Flow 'volume_create_manager' (a3bc6949-d497-49e6-ad7a-5ec60af0c247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af3ab91-edef-4649-9f47-d2d838910bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af3ab91-edef-4649-9f47-d2d838910bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-642019019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0bab92c02b94747abff8387833df65a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b5f8cb56-1209-42bb-825c-9a9d3d2da1ed,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:19:54Z,use_quota=True,user_id='405eb386f1074d9285bb65c0f6f663fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02c3b4f-2b89-459c-a3e9-92c6714f2239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02c3b4f-2b89-459c-a3e9-92c6714f2239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74f221a-99f0-4e75-b7d3-2397a786bed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74f221a-99f0-4e75-b7d3-2397a786bed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076', 'volume_name': 'volume-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076', 'volume_size': 1, 'snapshot_id': 'b5f8cb56-1209-42bb-825c-9a9d3d2da1ed'}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ecfd2d-4f19-40b7-96b1-546085634d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ecfd2d-4f19-40b7-96b1-546085634d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2750981f-646e-4f6a-82be-c6e0c6bb1c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:53 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Volume 4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076', 'volume_size': 1, 'snapshot_id': 'b5f8cb56-1209-42bb-825c-9a9d3d2da1ed'} Jun 30 16:19:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:54 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0 1073741824" returned: 0 in 0.927s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:54 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0 Jun 30 16:19:54 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:54 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0" returned: 0 in 0.651s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.977s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "cinder-quobyte-b5f8cb56-1209-42bb-825c-9a9d3d2da1ed-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076" by "_create_volume_from_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c8adaf-fc11-4bc9-b59f-8739977e4f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40024e0e-9af0-4150-a5ce-792a697b79a0', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8afe1134-0ea0-418a-8ae6-2b65aa235d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-quobyte-b5f8cb56-1209-42bb-825c-9a9d3d2da1ed-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Creating volume 4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076 from snapshot b5f8cb56-1209-42bb-825c-9a9d3d2da1ed {{(pid=93781) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "cinder-quobyte-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076" by "_copy_volume_from_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:19:54 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Volume volume-40024e0e-9af0-4150-a5ce-792a697b79a0 (40024e0e-9af0-4150-a5ce-792a697b79a0): created successfully Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8afe1134-0ea0-418a-8ae6-2b65aa235d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Flow 'volume_create_manager' (19838da8-82a4-4a9c-ab82-ce39b5627f2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-quobyte-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] snapshot: b5f8cb56-1209-42bb-825c-9a9d3d2da1ed, volume: 4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076, {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 30 16:19:54 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-cd1518b1-6cf8-4649-8e20-70fd9856c0c9 tempest-VolumesSnapshotTestJSON-1056995611 None] Created volume successfully. Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d723dd-dac1-409c-b7f6-008d5743b4e0]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:19:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.b5f8cb56-1209-42bb-825c-9a9d3d2da1ed {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:55 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.b5f8cb56-1209-42bb-825c-9a9d3d2da1ed Jun 30 16:19:55 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-141f3c53-c251-462c-97f2-56273553dbe7 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:19:55 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.b5f8cb56-1209-42bb-825c-9a9d3d2da1ed" returned: 0 in 0.848s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:55 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d821ba0-be8b-4aab-80f2-7be382214461(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:19:55 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] will copy from snapshot at /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461 {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 30 16:19:55 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Creating direct copy from snapshot {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 30 16:19:55 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f51406-dce5-487e-9ed0-3936ae0ebe63]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:19:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:55 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461 Jun 30 16:19:55 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:19:56 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Jun 30 16:19:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461" returned: 0 in 0.777s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:19:56 devstack cinder-volume[93781]: DEBUG cinder.utils [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Path /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076 not found in is_blk_device check {{(pid=93781) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 30 16:19:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:19:56 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076 Jun 30 16:19:56 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:01 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076" returned: 0 in 5.046s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:01 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[9562e832-bf34-4d41-9fc4-2748cedec831]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:01 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461 Jun 30 16:20:01 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:02 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461" returned: 0 in 1.042s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:02 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Image conversion details: src /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461, size 1024.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076 {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:20:02 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Converted 1024.00 MB image at 202.87 MB/s Jun 30 16:20:02 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076 is being set with open permissions: ugo+rw Jun 30 16:20:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:02 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076 Jun 30 16:20:02 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:03 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076" returned: 0 in 0.733s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:03 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-quobyte-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076" released by "_copy_volume_from_snapshot" :: held 8.567s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:03 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-quobyte-b5f8cb56-1209-42bb-825c-9a9d3d2da1ed-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076" released by "_create_volume_from_snapshot" :: held 8.621s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.662s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-141f3c53-c251-462c-97f2-56273553dbe7 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.141s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-141f3c53-c251-462c-97f2-56273553dbe7 tempest-VolumesSnapshotTestJSON-1056995611 None] Creating offline snapshot a768da7c-80b2-47ee-9b2a-982578eee2cc of volume 40024e0e-9af0-4150-a5ce-792a697b79a0 {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:20:03 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=84,cinder:INSERT=26,cinder:UPDATE=104,cinder:DELETE=10 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:20:03 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[92362cb6-f1ac-4116-a7df-7444675c0f13]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-141f3c53-c251-462c-97f2-56273553dbe7 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2750981f-646e-4f6a-82be-c6e0c6bb1c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076', 'volume_size': 1, 'snapshot_id': 'b5f8cb56-1209-42bb-825c-9a9d3d2da1ed'}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dabdf96-568c-40ad-99e5-950b6c623664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:03 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Volume volume-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076 (4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076): created successfully Jun 30 16:20:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dabdf96-568c-40ad-99e5-950b6c623664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Flow 'volume_create_manager' (a3bc6949-d497-49e6-ad7a-5ec60af0c247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:20:03 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-f110b75c-e4cf-46cc-bb1d-8547bea0069b tempest-VolumesDeleteCascade-2018007775 None] Created volume successfully. Jun 30 16:20:03 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0 Jun 30 16:20:03 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:04 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-141f3c53-c251-462c-97f2-56273553dbe7 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0" returned: 0 in 0.839s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-141f3c53-c251-462c-97f2-56273553dbe7 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.a768da7c-80b2-47ee-9b2a-982578eee2cc 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:04 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.a768da7c-80b2-47ee-9b2a-982578eee2cc 1G Jun 30 16:20:04 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "cinder-9d821ba0-be8b-4aab-80f2-7be382214461-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-9d821ba0-be8b-4aab-80f2-7be382214461-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:04 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Performing cascade delete. {{(pid=93781) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 30 16:20:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "cinder-b5f8cb56-1209-42bb-825c-9a9d3d2da1ed-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-b5f8cb56-1209-42bb-825c-9a9d3d2da1ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "cinder-quobyte-9d821ba0-be8b-4aab-80f2-7be382214461" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-quobyte-9d821ba0-be8b-4aab-80f2-7be382214461" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "cinder-quobyte-b5f8cb56-1209-42bb-825c-9a9d3d2da1ed" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-quobyte-b5f8cb56-1209-42bb-825c-9a9d3d2da1ed" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:04 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Deleting offline snapshot b5f8cb56-1209-42bb-825c-9a9d3d2da1ed of volume 9d821ba0-be8b-4aab-80f2-7be382214461 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:20:04 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] snapshot_file for this snap is: volume-9d821ba0-be8b-4aab-80f2-7be382214461.b5f8cb56-1209-42bb-825c-9a9d3d2da1ed {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:20:04 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[013a9d4c-9e1e-4af1-96bf-86b6c2e27391]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.b5f8cb56-1209-42bb-825c-9a9d3d2da1ed {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:05 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.b5f8cb56-1209-42bb-825c-9a9d3d2da1ed Jun 30 16:20:05 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:05 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-141f3c53-c251-462c-97f2-56273553dbe7 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.a768da7c-80b2-47ee-9b2a-982578eee2cc 1G" returned: 0 in 0.845s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-141f3c53-c251-462c-97f2-56273553dbe7 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40024e0e-9af0-4150-a5ce-792a697b79a0 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.a768da7c-80b2-47ee-9b2a-982578eee2cc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:05 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40024e0e-9af0-4150-a5ce-792a697b79a0 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.a768da7c-80b2-47ee-9b2a-982578eee2cc Jun 30 16:20:05 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:05 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.b5f8cb56-1209-42bb-825c-9a9d3d2da1ed" returned: 0 in 0.879s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:05 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d821ba0-be8b-4aab-80f2-7be382214461(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:20:05 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c6fe0c-a109-4f18-99a5-0ee42db3c94b]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:05 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-141f3c53-c251-462c-97f2-56273553dbe7 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40024e0e-9af0-4150-a5ce-792a697b79a0 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.a768da7c-80b2-47ee-9b2a-982578eee2cc" returned: 0 in 0.744s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:05 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-141f3c53-c251-462c-97f2-56273553dbe7 tempest-VolumesSnapshotTestJSON-1056995611 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.a768da7c-80b2-47ee-9b2a-982578eee2cc is being set with open permissions: ugo+rw Jun 30 16:20:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-141f3c53-c251-462c-97f2-56273553dbe7 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.a768da7c-80b2-47ee-9b2a-982578eee2cc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:05 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461 Jun 30 16:20:05 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:05 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.a768da7c-80b2-47ee-9b2a-982578eee2cc Jun 30 16:20:05 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:06 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-141f3c53-c251-462c-97f2-56273553dbe7 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.a768da7c-80b2-47ee-9b2a-982578eee2cc" returned: 0 in 0.701s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:06 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461" returned: 0 in 0.827s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.b5f8cb56-1209-42bb-825c-9a9d3d2da1ed {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-141f3c53-c251-462c-97f2-56273553dbe7 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:06 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.b5f8cb56-1209-42bb-825c-9a9d3d2da1ed Jun 30 16:20:06 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:06 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.info Jun 30 16:20:06 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:07 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-141f3c53-c251-462c-97f2-56273553dbe7 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.info" returned: 0 in 0.746s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:07 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-141f3c53-c251-462c-97f2-56273553dbe7 tempest-VolumesSnapshotTestJSON-1056995611 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.info is being set with open permissions: ugo+rw Jun 30 16:20:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-141f3c53-c251-462c-97f2-56273553dbe7 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:07 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.info Jun 30 16:20:07 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:07 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.b5f8cb56-1209-42bb-825c-9a9d3d2da1ed" returned: 0 in 0.867s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.b5f8cb56-1209-42bb-825c-9a9d3d2da1ed {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:07 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.b5f8cb56-1209-42bb-825c-9a9d3d2da1ed Jun 30 16:20:07 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:08 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-141f3c53-c251-462c-97f2-56273553dbe7 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.info" returned: 0 in 0.735s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-141f3c53-c251-462c-97f2-56273553dbe7 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.743s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:08 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-141f3c53-c251-462c-97f2-56273553dbe7 tempest-VolumesSnapshotTestJSON-1056995611 None] Create snapshot completed successfully Jun 30 16:20:08 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461.b5f8cb56-1209-42bb-825c-9a9d3d2da1ed" returned: 0 in 0.717s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:08 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-quobyte-b5f8cb56-1209-42bb-825c-9a9d3d2da1ed" released by "_delete_snapshot" :: held 3.401s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:08 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-quobyte-9d821ba0-be8b-4aab-80f2-7be382214461" released by "delete_snapshot" :: held 3.427s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:08 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Created reservations ['c76b0e54-efa7-4040-884b-55011ab31a6f', '832f36e1-74bc-4eae-a991-47869aaa178d', '6bc84d32-8336-4aa6-9071-60f8575432d4', '26e953bc-ab72-439a-a0fe-3b6edb4f677c'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:20:08 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Delete snapshot completed successfully. Jun 30 16:20:08 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-b5f8cb56-1209-42bb-825c-9a9d3d2da1ed-delete_snapshot" released by "delete_snapshot" :: held 3.598s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Snapshots deleted, issuing volume delete {{(pid=93781) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 30 16:20:08 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "cinder-quobyte-9d821ba0-be8b-4aab-80f2-7be382214461" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:08 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-quobyte-9d821ba0-be8b-4aab-80f2-7be382214461" acquired by "delete_volume" :: waited 0.015s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:08 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac706051-698e-4a96-96cb-3f3edf81ea6b]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:08 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461 Jun 30 16:20:08 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:09 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461" returned: 0 in 0.843s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:09 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461 Jun 30 16:20:09 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Flow 'volume_create_manager' (c24ad96f-6e89-42b1-b801-1089f8e04cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ad43e4-be98-4d96-a3c5-4aa4792e6470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ad43e4-be98-4d96-a3c5-4aa4792e6470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2146857347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6f309ba-15ab-4cc0-b504-c8be29ef451a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84840f58dc3f4285853db090b3507452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:20:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a768da7c-80b2-47ee-9b2a-982578eee2cc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:20:10Z,use_quota=True,user_id='7592a53d4232498ca6082ced67456e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad605c69-e587-473a-970c-2c745e665e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad605c69-e587-473a-970c-2c745e665e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc312e9-be08-4935-bede-4ea1a998097f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc312e9-be08-4935-bede-4ea1a998097f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f6f309ba-15ab-4cc0-b504-c8be29ef451a', 'volume_name': 'volume-f6f309ba-15ab-4cc0-b504-c8be29ef451a', 'volume_size': 2, 'snapshot_id': 'a768da7c-80b2-47ee-9b2a-982578eee2cc'}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249ce0ce-90e4-4919-b39d-ab5807caecfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249ce0ce-90e4-4919-b39d-ab5807caecfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce57e9a-2131-43c6-9f3b-9f13290fc2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:09 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Volume f6f309ba-15ab-4cc0-b504-c8be29ef451a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f6f309ba-15ab-4cc0-b504-c8be29ef451a', 'volume_size': 2, 'snapshot_id': 'a768da7c-80b2-47ee-9b2a-982578eee2cc'} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "cinder-quobyte-a768da7c-80b2-47ee-9b2a-982578eee2cc-f6f309ba-15ab-4cc0-b504-c8be29ef451a" by "_create_volume_from_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-a768da7c-80b2-47ee-9b2a-982578eee2cc-f6f309ba-15ab-4cc0-b504-c8be29ef451a" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Creating volume f6f309ba-15ab-4cc0-b504-c8be29ef451a from snapshot a768da7c-80b2-47ee-9b2a-982578eee2cc {{(pid=93781) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "cinder-quobyte-f6f309ba-15ab-4cc0-b504-c8be29ef451a" by "_copy_volume_from_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-f6f309ba-15ab-4cc0-b504-c8be29ef451a" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] snapshot: a768da7c-80b2-47ee-9b2a-982578eee2cc, volume: f6f309ba-15ab-4cc0-b504-c8be29ef451a, {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e62e28-17e8-4e8d-92cb-e3b4d5406103]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.a768da7c-80b2-47ee-9b2a-982578eee2cc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:09 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.a768da7c-80b2-47ee-9b2a-982578eee2cc Jun 30 16:20:09 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:10 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9d821ba0-be8b-4aab-80f2-7be382214461" returned: 0 in 0.786s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:10 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-quobyte-9d821ba0-be8b-4aab-80f2-7be382214461" released by "delete_volume" :: held 1.704s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:10 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Created reservations ['8f394baa-30ef-4032-91fc-e75dd6e78775', 'b2cd2593-80bd-46aa-a689-8964b14391f3', 'e1763539-08bb-44d9-b07f-7bfd75c842d8', '7fba0f57-b1b9-4d11-a30e-b35fbc3dc6dd'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:20:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:20:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:20:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:20:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:10 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:20:10 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:10 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.a768da7c-80b2-47ee-9b2a-982578eee2cc" returned: 0 in 0.837s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40024e0e-9af0-4150-a5ce-792a697b79a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:20:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] will copy from snapshot at /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0 {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 30 16:20:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Creating direct copy from snapshot {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 30 16:20:10 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8000dc-4c8c-44b1-bbb0-2a14b49b6ce2]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:10 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0 Jun 30 16:20:10 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:10 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.715s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:10 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:20:11 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Deleted volume successfully. Jun 30 16:20:11 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-87aa0bf2-a516-400a-aad4-77fe82c02281 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-9d821ba0-be8b-4aab-80f2-7be382214461-delete_volume" released by "delete_volume" :: held 6.304s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:11 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-055db16e-15f7-416e-a6e0-3b0cbc969221 tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "cinder-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:11 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-055db16e-15f7-416e-a6e0-3b0cbc969221 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:11 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-055db16e-15f7-416e-a6e0-3b0cbc969221 tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "cinder-quobyte-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:11 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-055db16e-15f7-416e-a6e0-3b0cbc969221 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-quobyte-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076" acquired by "delete_volume" :: waited 0.025s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:11 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1d7069-f6d5-4405-9b49-11ce12796c3d]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-055db16e-15f7-416e-a6e0-3b0cbc969221 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:11 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0" returned: 0 in 0.816s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:11 devstack cinder-volume[93781]: DEBUG cinder.utils [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Path /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f309ba-15ab-4cc0-b504-c8be29ef451a not found in is_blk_device check {{(pid=93781) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 30 16:20:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f309ba-15ab-4cc0-b504-c8be29ef451a {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:11 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f309ba-15ab-4cc0-b504-c8be29ef451a Jun 30 16:20:11 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:11 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076 Jun 30 16:20:11 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:12 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-055db16e-15f7-416e-a6e0-3b0cbc969221 tempest-VolumesDeleteCascade-2018007775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076" returned: 0 in 0.856s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-055db16e-15f7-416e-a6e0-3b0cbc969221 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:12 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076 Jun 30 16:20:12 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:13 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-055db16e-15f7-416e-a6e0-3b0cbc969221 tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076" returned: 0 in 1.329s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:13 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-055db16e-15f7-416e-a6e0-3b0cbc969221 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-quobyte-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076" released by "delete_volume" :: held 2.257s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:13 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-055db16e-15f7-416e-a6e0-3b0cbc969221 tempest-VolumesDeleteCascade-2018007775 None] Created reservations ['06cd502f-90ff-4ac6-874f-e9e376580c0d', 'e8a47c51-687c-4d88-be13-2833fb445ad2', '79aeae23-5d1e-47b2-a37a-b34417c9cc53', '274168b6-b477-40c8-9e88-4e4ba3cc7508'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:20:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-055db16e-15f7-416e-a6e0-3b0cbc969221 tempest-VolumesDeleteCascade-2018007775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:20:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-055db16e-15f7-416e-a6e0-3b0cbc969221 tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-055db16e-15f7-416e-a6e0-3b0cbc969221 tempest-VolumesDeleteCascade-2018007775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:20:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-055db16e-15f7-416e-a6e0-3b0cbc969221 tempest-VolumesDeleteCascade-2018007775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:20:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-055db16e-15f7-416e-a6e0-3b0cbc969221 tempest-VolumesDeleteCascade-2018007775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-055db16e-15f7-416e-a6e0-3b0cbc969221 tempest-VolumesDeleteCascade-2018007775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:14 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:20:14 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:15 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-055db16e-15f7-416e-a6e0-3b0cbc969221 tempest-VolumesDeleteCascade-2018007775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.435s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:15 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-055db16e-15f7-416e-a6e0-3b0cbc969221 tempest-VolumesDeleteCascade-2018007775 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:20:15 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-055db16e-15f7-416e-a6e0-3b0cbc969221 tempest-VolumesDeleteCascade-2018007775 None] Deleted volume successfully. Jun 30 16:20:15 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-055db16e-15f7-416e-a6e0-3b0cbc969221 tempest-VolumesDeleteCascade-2018007775 None] Lock "cinder-4dfa8ec9-070f-4cea-a7ad-f8f7cf88b076-delete_volume" released by "delete_volume" :: held 4.216s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:16 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f309ba-15ab-4cc0-b504-c8be29ef451a" returned: 0 in 4.964s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:16 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e26a7a7-bcb1-486a-bb22-48fe1e34724b]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:16 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0 Jun 30 16:20:16 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:17 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0" returned: 0 in 1.117s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:17 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Image conversion details: src /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f309ba-15ab-4cc0-b504-c8be29ef451a {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:20:17 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Converted 1024.00 MB image at 206.23 MB/s Jun 30 16:20:17 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f309ba-15ab-4cc0-b504-c8be29ef451a is being set with open permissions: ugo+rw Jun 30 16:20:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f309ba-15ab-4cc0-b504-c8be29ef451a {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:17 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f309ba-15ab-4cc0-b504-c8be29ef451a Jun 30 16:20:17 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:18 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f309ba-15ab-4cc0-b504-c8be29ef451a" returned: 0 in 0.715s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:18 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-f6f309ba-15ab-4cc0-b504-c8be29ef451a" released by "_copy_volume_from_snapshot" :: held 8.567s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:18 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-a768da7c-80b2-47ee-9b2a-982578eee2cc-f6f309ba-15ab-4cc0-b504-c8be29ef451a" released by "_create_volume_from_snapshot" :: held 8.602s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.622s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce57e9a-2131-43c6-9f3b-9f13290fc2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6f309ba-15ab-4cc0-b504-c8be29ef451a', 'volume_size': 2, 'snapshot_id': 'a768da7c-80b2-47ee-9b2a-982578eee2cc'}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d1688c-2c62-4e9a-8c2a-998c21bedb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:18 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Volume volume-f6f309ba-15ab-4cc0-b504-c8be29ef451a (f6f309ba-15ab-4cc0-b504-c8be29ef451a): created successfully Jun 30 16:20:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d1688c-2c62-4e9a-8c2a-998c21bedb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Flow 'volume_create_manager' (c24ad96f-6e89-42b1-b801-1089f8e04cbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:20:18 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-e9a3b34e-b121-4af2-91ec-935c082e3c2c tempest-VolumesSnapshotTestJSON-1056995611 None] Created volume successfully. Jun 30 16:20:19 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-31e922fa-ce8f-45b1-ae55-45a203904508 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "cinder-f6f309ba-15ab-4cc0-b504-c8be29ef451a-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:19 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-31e922fa-ce8f-45b1-ae55-45a203904508 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-f6f309ba-15ab-4cc0-b504-c8be29ef451a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:19 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-31e922fa-ce8f-45b1-ae55-45a203904508 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "cinder-quobyte-f6f309ba-15ab-4cc0-b504-c8be29ef451a" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:19 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-31e922fa-ce8f-45b1-ae55-45a203904508 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-f6f309ba-15ab-4cc0-b504-c8be29ef451a" acquired by "delete_volume" :: waited 0.023s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:19 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[88495349-ec74-4f16-84c9-033b98b56723]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-31e922fa-ce8f-45b1-ae55-45a203904508 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f309ba-15ab-4cc0-b504-c8be29ef451a {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:19 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f309ba-15ab-4cc0-b504-c8be29ef451a Jun 30 16:20:19 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:20 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-31e922fa-ce8f-45b1-ae55-45a203904508 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f309ba-15ab-4cc0-b504-c8be29ef451a" returned: 0 in 0.870s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-31e922fa-ce8f-45b1-ae55-45a203904508 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f309ba-15ab-4cc0-b504-c8be29ef451a {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:20 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f309ba-15ab-4cc0-b504-c8be29ef451a Jun 30 16:20:20 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Flow 'volume_create_manager' (38217e8b-2542-4588-bb4d-c5dd1f9737db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c4f382-7f15-4f8e-bf92-38950b6ce984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c4f382-7f15-4f8e-bf92-38950b6ce984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1576779113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56695b84-faee-4cbf-a939-5aec47292551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1963d36bdc5742aa9506be4e19827ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:20:21Z,use_quota=True,user_id='8e488df923804f7f806b04a617f9f04a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdbf919-1454-4af3-b4cc-50a454cc2ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdbf919-1454-4af3-b4cc-50a454cc2ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8d4d91-0af2-4e88-bf12-93dfe281dcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8d4d91-0af2-4e88-bf12-93dfe281dcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56695b84-faee-4cbf-a939-5aec47292551', 'volume_name': 'volume-56695b84-faee-4cbf-a939-5aec47292551', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2ea73b-d1dd-4de3-9253-1238a84bda11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2ea73b-d1dd-4de3-9253-1238a84bda11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849c3cb8-68e5-4ecd-aaba-63335f0aec63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:20 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Volume 56695b84-faee-4cbf-a939-5aec47292551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56695b84-faee-4cbf-a939-5aec47292551', 'volume_size': 1} Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1576779113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56695b84-faee-4cbf-a939-5aec47292551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1963d36bdc5742aa9506be4e19827ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:20:21Z,use_quota=True,user_id='8e488df923804f7f806b04a617f9f04a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Creating volume 56695b84-faee-4cbf-a939-5aec47292551 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:20:20 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:20:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-56695b84-faee-4cbf-a939-5aec47292551 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:20 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-56695b84-faee-4cbf-a939-5aec47292551 1073741824 Jun 30 16:20:20 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:21 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-31e922fa-ce8f-45b1-ae55-45a203904508 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6f309ba-15ab-4cc0-b504-c8be29ef451a" returned: 0 in 0.653s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-31e922fa-ce8f-45b1-ae55-45a203904508 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-f6f309ba-15ab-4cc0-b504-c8be29ef451a" released by "delete_volume" :: held 1.575s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:21 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-31e922fa-ce8f-45b1-ae55-45a203904508 tempest-VolumesSnapshotTestJSON-1056995611 None] Created reservations ['0028b507-71a5-43d7-aac1-88752aa0b3a0', 'f3cbae19-f145-462e-b7d0-ce1f4387843f', '9e5d4289-3f77-4a86-8159-f4e8b07fa21b', 'e87e741b-ae46-4905-9c25-b16b4958af24'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:20:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-31e922fa-ce8f-45b1-ae55-45a203904508 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:20:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-31e922fa-ce8f-45b1-ae55-45a203904508 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-31e922fa-ce8f-45b1-ae55-45a203904508 tempest-VolumesSnapshotTestJSON-1056995611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:20:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-31e922fa-ce8f-45b1-ae55-45a203904508 tempest-VolumesSnapshotTestJSON-1056995611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:20:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-31e922fa-ce8f-45b1-ae55-45a203904508 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-31e922fa-ce8f-45b1-ae55-45a203904508 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:21 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:20:21 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:21 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-56695b84-faee-4cbf-a939-5aec47292551 1073741824" returned: 0 in 0.957s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-56695b84-faee-4cbf-a939-5aec47292551 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:21 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-56695b84-faee-4cbf-a939-5aec47292551 Jun 30 16:20:21 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-bd0661a9-642a-4b15-81fb-8f74d773d3bc tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "cinder-a768da7c-80b2-47ee-9b2a-982578eee2cc-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-bd0661a9-642a-4b15-81fb-8f74d773d3bc tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-a768da7c-80b2-47ee-9b2a-982578eee2cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-bd0661a9-642a-4b15-81fb-8f74d773d3bc tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "cinder-quobyte-40024e0e-9af0-4150-a5ce-792a697b79a0" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:22 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-bd0661a9-642a-4b15-81fb-8f74d773d3bc tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-40024e0e-9af0-4150-a5ce-792a697b79a0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:22 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-bd0661a9-642a-4b15-81fb-8f74d773d3bc tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "cinder-quobyte-a768da7c-80b2-47ee-9b2a-982578eee2cc" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:22 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-bd0661a9-642a-4b15-81fb-8f74d773d3bc tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-a768da7c-80b2-47ee-9b2a-982578eee2cc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:22 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-bd0661a9-642a-4b15-81fb-8f74d773d3bc tempest-VolumesSnapshotTestJSON-1056995611 None] Deleting offline snapshot a768da7c-80b2-47ee-9b2a-982578eee2cc of volume 40024e0e-9af0-4150-a5ce-792a697b79a0 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:20:22 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-bd0661a9-642a-4b15-81fb-8f74d773d3bc tempest-VolumesSnapshotTestJSON-1056995611 None] snapshot_file for this snap is: volume-40024e0e-9af0-4150-a5ce-792a697b79a0.a768da7c-80b2-47ee-9b2a-982578eee2cc {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:20:22 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f177453-e501-4ab8-b7e8-9e5027415339]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bd0661a9-642a-4b15-81fb-8f74d773d3bc tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.a768da7c-80b2-47ee-9b2a-982578eee2cc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:22 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.a768da7c-80b2-47ee-9b2a-982578eee2cc Jun 30 16:20:22 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:22 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-31e922fa-ce8f-45b1-ae55-45a203904508 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.788s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:22 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-31e922fa-ce8f-45b1-ae55-45a203904508 tempest-VolumesSnapshotTestJSON-1056995611 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:20:22 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-31e922fa-ce8f-45b1-ae55-45a203904508 tempest-VolumesSnapshotTestJSON-1056995611 None] Deleted volume successfully. Jun 30 16:20:22 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-31e922fa-ce8f-45b1-ae55-45a203904508 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-f6f309ba-15ab-4cc0-b504-c8be29ef451a-delete_volume" released by "delete_volume" :: held 2.609s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:22 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-56695b84-faee-4cbf-a939-5aec47292551" returned: 0 in 0.805s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:22 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:20:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:22 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849c3cb8-68e5-4ecd-aaba-63335f0aec63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56695b84-faee-4cbf-a939-5aec47292551', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:22 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8b1d4a-ffd4-470e-a4c7-549321192d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:22 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Volume volume-56695b84-faee-4cbf-a939-5aec47292551 (56695b84-faee-4cbf-a939-5aec47292551): created successfully Jun 30 16:20:22 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8b1d4a-ffd4-470e-a4c7-549321192d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:22 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Flow 'volume_create_manager' (38217e8b-2542-4588-bb4d-c5dd1f9737db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:20:22 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-ebf4b816-e592-4ded-bfd5-d0922838bdda tempest-VolumesTransfersTest-838674659 None] Created volume successfully. Jun 30 16:20:22 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bd0661a9-642a-4b15-81fb-8f74d773d3bc tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.a768da7c-80b2-47ee-9b2a-982578eee2cc" returned: 0 in 0.837s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:22 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-bd0661a9-642a-4b15-81fb-8f74d773d3bc tempest-VolumesSnapshotTestJSON-1056995611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40024e0e-9af0-4150-a5ce-792a697b79a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:20:22 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[6091dc9d-9f0c-4bbc-8e4b-5abcec9aca5f]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bd0661a9-642a-4b15-81fb-8f74d773d3bc tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:23 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0 Jun 30 16:20:23 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:23 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-4c6f549c-fb93-45d2-92b0-7e46eb2d5a42 tempest-VolumesTransfersTest-1547048505 None] Transfer volume completed successfully. Jun 30 16:20:23 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bd0661a9-642a-4b15-81fb-8f74d773d3bc tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0" returned: 0 in 0.870s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bd0661a9-642a-4b15-81fb-8f74d773d3bc tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.a768da7c-80b2-47ee-9b2a-982578eee2cc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:23 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.a768da7c-80b2-47ee-9b2a-982578eee2cc Jun 30 16:20:23 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:24 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bd0661a9-642a-4b15-81fb-8f74d773d3bc tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.a768da7c-80b2-47ee-9b2a-982578eee2cc" returned: 0 in 0.814s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bd0661a9-642a-4b15-81fb-8f74d773d3bc tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.a768da7c-80b2-47ee-9b2a-982578eee2cc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:24 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-72c35787-8d7c-4234-88c7-84c8d23adea9 tempest-VolumesTransfersTest-1062377679 None] Acquiring lock "cinder-56695b84-faee-4cbf-a939-5aec47292551-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:24 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.a768da7c-80b2-47ee-9b2a-982578eee2cc Jun 30 16:20:24 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:24 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-72c35787-8d7c-4234-88c7-84c8d23adea9 tempest-VolumesTransfersTest-1062377679 None] Lock "cinder-56695b84-faee-4cbf-a939-5aec47292551-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:24 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-72c35787-8d7c-4234-88c7-84c8d23adea9 tempest-VolumesTransfersTest-1062377679 None] Acquiring lock "cinder-quobyte-56695b84-faee-4cbf-a939-5aec47292551" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:24 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-72c35787-8d7c-4234-88c7-84c8d23adea9 tempest-VolumesTransfersTest-1062377679 None] Lock "cinder-quobyte-56695b84-faee-4cbf-a939-5aec47292551" acquired by "delete_volume" :: waited 0.017s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:24 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c13e7dc-a862-4a94-9b9d-2db5eed7f2cd]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-72c35787-8d7c-4234-88c7-84c8d23adea9 tempest-VolumesTransfersTest-1062377679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-56695b84-faee-4cbf-a939-5aec47292551 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:24 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-56695b84-faee-4cbf-a939-5aec47292551 Jun 30 16:20:24 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:25 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-bd0661a9-642a-4b15-81fb-8f74d773d3bc tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0.a768da7c-80b2-47ee-9b2a-982578eee2cc" returned: 0 in 0.711s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-bd0661a9-642a-4b15-81fb-8f74d773d3bc tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-a768da7c-80b2-47ee-9b2a-982578eee2cc" released by "_delete_snapshot" :: held 3.355s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-bd0661a9-642a-4b15-81fb-8f74d773d3bc tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-40024e0e-9af0-4150-a5ce-792a697b79a0" released by "delete_snapshot" :: held 3.383s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:25 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-bd0661a9-642a-4b15-81fb-8f74d773d3bc tempest-VolumesSnapshotTestJSON-1056995611 None] Created reservations ['301d3bc6-de2f-4156-bc0b-d2b2349dd046', 'cb2eca19-b942-434e-b47b-dcdcabb6aa35', '68b43de8-ee2d-41cc-acdb-c6abcd8fa49a', '484cf137-6483-4683-841d-0992b72aaa1c'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:20:25 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-bd0661a9-642a-4b15-81fb-8f74d773d3bc tempest-VolumesSnapshotTestJSON-1056995611 None] Delete snapshot completed successfully. Jun 30 16:20:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-bd0661a9-642a-4b15-81fb-8f74d773d3bc tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-a768da7c-80b2-47ee-9b2a-982578eee2cc-delete_snapshot" released by "delete_snapshot" :: held 3.564s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:25 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-72c35787-8d7c-4234-88c7-84c8d23adea9 tempest-VolumesTransfersTest-1062377679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-56695b84-faee-4cbf-a939-5aec47292551" returned: 0 in 0.825s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-72c35787-8d7c-4234-88c7-84c8d23adea9 tempest-VolumesTransfersTest-1062377679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-56695b84-faee-4cbf-a939-5aec47292551 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:25 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-56695b84-faee-4cbf-a939-5aec47292551 Jun 30 16:20:25 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:26 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-72c35787-8d7c-4234-88c7-84c8d23adea9 tempest-VolumesTransfersTest-1062377679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-56695b84-faee-4cbf-a939-5aec47292551" returned: 0 in 0.651s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:26 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-72c35787-8d7c-4234-88c7-84c8d23adea9 tempest-VolumesTransfersTest-1062377679 None] Lock "cinder-quobyte-56695b84-faee-4cbf-a939-5aec47292551" released by "delete_volume" :: held 1.514s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:26 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-72c35787-8d7c-4234-88c7-84c8d23adea9 tempest-VolumesTransfersTest-1062377679 None] Created reservations ['409baa3d-25c4-4ce7-8c4a-f8ba766b9aae', 'e989678e-0636-49ad-9025-4c0c47007008', 'c97fabc5-9c0c-487d-ba56-f4183a55f4bd', '25345272-387a-4cc7-bc0c-973e899f989f'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:20:26 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-59298efd-1b2d-4a8f-b761-cc4c7998acdf tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "cinder-40024e0e-9af0-4150-a5ce-792a697b79a0-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:26 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-59298efd-1b2d-4a8f-b761-cc4c7998acdf tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-40024e0e-9af0-4150-a5ce-792a697b79a0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-72c35787-8d7c-4234-88c7-84c8d23adea9 tempest-VolumesTransfersTest-1062377679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:20:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-72c35787-8d7c-4234-88c7-84c8d23adea9 tempest-VolumesTransfersTest-1062377679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:26 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-72c35787-8d7c-4234-88c7-84c8d23adea9 tempest-VolumesTransfersTest-1062377679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:20:26 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-72c35787-8d7c-4234-88c7-84c8d23adea9 tempest-VolumesTransfersTest-1062377679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:20:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-72c35787-8d7c-4234-88c7-84c8d23adea9 tempest-VolumesTransfersTest-1062377679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-72c35787-8d7c-4234-88c7-84c8d23adea9 tempest-VolumesTransfersTest-1062377679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:26 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:20:26 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:26 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-59298efd-1b2d-4a8f-b761-cc4c7998acdf tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "cinder-quobyte-40024e0e-9af0-4150-a5ce-792a697b79a0" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:26 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-59298efd-1b2d-4a8f-b761-cc4c7998acdf tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-40024e0e-9af0-4150-a5ce-792a697b79a0" acquired by "delete_volume" :: waited 0.016s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:26 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce6b7ab-af30-4859-80fa-b6b926cc0e94]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-59298efd-1b2d-4a8f-b761-cc4c7998acdf tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:26 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0 Jun 30 16:20:26 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:27 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-72c35787-8d7c-4234-88c7-84c8d23adea9 tempest-VolumesTransfersTest-1062377679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.767s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-72c35787-8d7c-4234-88c7-84c8d23adea9 tempest-VolumesTransfersTest-1062377679 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:20:27 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-72c35787-8d7c-4234-88c7-84c8d23adea9 tempest-VolumesTransfersTest-1062377679 None] Deleted volume successfully. Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-72c35787-8d7c-4234-88c7-84c8d23adea9 tempest-VolumesTransfersTest-1062377679 None] Lock "cinder-56695b84-faee-4cbf-a939-5aec47292551-delete_volume" released by "delete_volume" :: held 2.536s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:27 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-59298efd-1b2d-4a8f-b761-cc4c7998acdf tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0" returned: 0 in 0.906s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-59298efd-1b2d-4a8f-b761-cc4c7998acdf tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:27 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0 Jun 30 16:20:27 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Flow 'volume_create_manager' (087477a2-497e-44c9-9be5-dc2ff622eb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c04161-b4db-4151-9ed7-763c704dbb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c04161-b4db-4151-9ed7-763c704dbb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1670552449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=278a3ae9-b998-4b35-8297-a4facbb1ea64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1963d36bdc5742aa9506be4e19827ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:20:27Z,use_quota=True,user_id='8e488df923804f7f806b04a617f9f04a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25f4e7f-12f5-4bab-8b07-118539514550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25f4e7f-12f5-4bab-8b07-118539514550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4ce335-501b-4c3c-b531-0587305913c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4ce335-501b-4c3c-b531-0587305913c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '278a3ae9-b998-4b35-8297-a4facbb1ea64', 'volume_name': 'volume-278a3ae9-b998-4b35-8297-a4facbb1ea64', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729ec44a-1912-42fa-b431-46dcf0b0fef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729ec44a-1912-42fa-b431-46dcf0b0fef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23922f2-a8df-4254-b65b-2b97e5044d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:27 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Volume 278a3ae9-b998-4b35-8297-a4facbb1ea64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-278a3ae9-b998-4b35-8297-a4facbb1ea64', 'volume_size': 1} Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1670552449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=278a3ae9-b998-4b35-8297-a4facbb1ea64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1963d36bdc5742aa9506be4e19827ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:20:27Z,use_quota=True,user_id='8e488df923804f7f806b04a617f9f04a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Creating volume 278a3ae9-b998-4b35-8297-a4facbb1ea64 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:20:27 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:20:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-278a3ae9-b998-4b35-8297-a4facbb1ea64 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:27 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-278a3ae9-b998-4b35-8297-a4facbb1ea64 1073741824 Jun 30 16:20:27 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:28 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-59298efd-1b2d-4a8f-b761-cc4c7998acdf tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-40024e0e-9af0-4150-a5ce-792a697b79a0" returned: 0 in 0.676s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:28 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-59298efd-1b2d-4a8f-b761-cc4c7998acdf tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-40024e0e-9af0-4150-a5ce-792a697b79a0" released by "delete_volume" :: held 1.651s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:28 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-59298efd-1b2d-4a8f-b761-cc4c7998acdf tempest-VolumesSnapshotTestJSON-1056995611 None] Created reservations ['4f6fd524-5d41-463e-a67a-ad7cce79f3db', '693567c5-dd53-4744-845c-44e0e215decf', '5819a607-56b4-4274-a115-bd36e380c954', '05d6b1aa-68df-4de8-9676-7423e76864bb'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:20:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-59298efd-1b2d-4a8f-b761-cc4c7998acdf tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:20:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-59298efd-1b2d-4a8f-b761-cc4c7998acdf tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:28 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-59298efd-1b2d-4a8f-b761-cc4c7998acdf tempest-VolumesSnapshotTestJSON-1056995611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:20:28 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-59298efd-1b2d-4a8f-b761-cc4c7998acdf tempest-VolumesSnapshotTestJSON-1056995611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:20:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-59298efd-1b2d-4a8f-b761-cc4c7998acdf tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-59298efd-1b2d-4a8f-b761-cc4c7998acdf tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:28 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:20:28 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:28 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-278a3ae9-b998-4b35-8297-a4facbb1ea64 1073741824" returned: 0 in 0.934s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-278a3ae9-b998-4b35-8297-a4facbb1ea64 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:28 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-278a3ae9-b998-4b35-8297-a4facbb1ea64 Jun 30 16:20:28 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:28 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-59298efd-1b2d-4a8f-b761-cc4c7998acdf tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.728s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:28 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-59298efd-1b2d-4a8f-b761-cc4c7998acdf tempest-VolumesSnapshotTestJSON-1056995611 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:20:28 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-59298efd-1b2d-4a8f-b761-cc4c7998acdf tempest-VolumesSnapshotTestJSON-1056995611 None] Deleted volume successfully. Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-59298efd-1b2d-4a8f-b761-cc4c7998acdf tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-40024e0e-9af0-4150-a5ce-792a697b79a0-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:20:29 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Flow 'volume_create_manager' (17705b37-a446-4657-9faf-6164edf5fa1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd14edb-a586-4c37-a59a-4b7b5c063b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-278a3ae9-b998-4b35-8297-a4facbb1ea64" returned: 0 in 0.690s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd14edb-a586-4c37-a59a-4b7b5c063b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-218421367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58dc44e7-797a-4fa9-b2f7-712330a4f79c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84840f58dc3f4285853db090b3507452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:20:29Z,use_quota=True,user_id='7592a53d4232498ca6082ced67456e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52000c5a-8940-4762-940c-e1d0d4a78468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52000c5a-8940-4762-940c-e1d0d4a78468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b391b87-660d-4fc9-a8a1-9726d1b5c7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b391b87-660d-4fc9-a8a1-9726d1b5c7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58dc44e7-797a-4fa9-b2f7-712330a4f79c', 'volume_name': 'volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d34012-920b-4701-8df5-96b18d248fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d34012-920b-4701-8df5-96b18d248fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a5e60d-8791-4636-93c0-8c4412dc00c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:29 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Volume 58dc44e7-797a-4fa9-b2f7-712330a4f79c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c', 'volume_size': 1} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-218421367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58dc44e7-797a-4fa9-b2f7-712330a4f79c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84840f58dc3f4285853db090b3507452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:20:29Z,use_quota=True,user_id='7592a53d4232498ca6082ced67456e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Creating volume 58dc44e7-797a-4fa9-b2f7-712330a4f79c {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:20:29 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23922f2-a8df-4254-b65b-2b97e5044d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-278a3ae9-b998-4b35-8297-a4facbb1ea64', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:29 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c 1073741824 Jun 30 16:20:29 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad2f398-5d38-45c9-b3b5-3d165b88bcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:29 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Volume volume-278a3ae9-b998-4b35-8297-a4facbb1ea64 (278a3ae9-b998-4b35-8297-a4facbb1ea64): created successfully Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad2f398-5d38-45c9-b3b5-3d165b88bcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Flow 'volume_create_manager' (087477a2-497e-44c9-9be5-dc2ff622eb56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:20:29 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-c79287ea-4286-4b59-8e5a-f420bcea5297 tempest-VolumesTransfersTest-838674659 None] Created volume successfully. Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-22e369b6-8206-40e7-92b2-c5623c3f9c90 tempest-VolumesTransfersTest-1062377679 None] Acquiring lock "cinder-278a3ae9-b998-4b35-8297-a4facbb1ea64-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-22e369b6-8206-40e7-92b2-c5623c3f9c90 tempest-VolumesTransfersTest-1062377679 None] Lock "cinder-278a3ae9-b998-4b35-8297-a4facbb1ea64-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-22e369b6-8206-40e7-92b2-c5623c3f9c90 tempest-VolumesTransfersTest-1062377679 None] Acquiring lock "cinder-quobyte-278a3ae9-b998-4b35-8297-a4facbb1ea64" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-22e369b6-8206-40e7-92b2-c5623c3f9c90 tempest-VolumesTransfersTest-1062377679 None] Lock "cinder-quobyte-278a3ae9-b998-4b35-8297-a4facbb1ea64" acquired by "delete_volume" :: waited 0.024s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:30 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f49033-c58c-42e7-9ed0-2753beb491ad]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-22e369b6-8206-40e7-92b2-c5623c3f9c90 tempest-VolumesTransfersTest-1062377679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-278a3ae9-b998-4b35-8297-a4facbb1ea64 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:30 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-278a3ae9-b998-4b35-8297-a4facbb1ea64 Jun 30 16:20:30 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:30 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c 1073741824" returned: 0 in 0.969s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:30 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c Jun 30 16:20:30 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:30 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-22e369b6-8206-40e7-92b2-c5623c3f9c90 tempest-VolumesTransfersTest-1062377679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-278a3ae9-b998-4b35-8297-a4facbb1ea64" returned: 0 in 0.800s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-22e369b6-8206-40e7-92b2-c5623c3f9c90 tempest-VolumesTransfersTest-1062377679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-278a3ae9-b998-4b35-8297-a4facbb1ea64 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:30 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-278a3ae9-b998-4b35-8297-a4facbb1ea64 Jun 30 16:20:30 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:31 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c" returned: 0 in 0.663s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:20:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a5e60d-8791-4636-93c0-8c4412dc00c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d6ff91-c31f-44bd-85e6-67874b001156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:31 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Volume volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c (58dc44e7-797a-4fa9-b2f7-712330a4f79c): created successfully Jun 30 16:20:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d6ff91-c31f-44bd-85e6-67874b001156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Flow 'volume_create_manager' (17705b37-a446-4657-9faf-6164edf5fa1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:20:31 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-4dc6223e-8da7-4315-bc36-cf927c998cec tempest-VolumesSnapshotTestJSON-1056995611 None] Created volume successfully. Jun 30 16:20:31 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-22e369b6-8206-40e7-92b2-c5623c3f9c90 tempest-VolumesTransfersTest-1062377679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-278a3ae9-b998-4b35-8297-a4facbb1ea64" returned: 0 in 0.665s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:31 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-22e369b6-8206-40e7-92b2-c5623c3f9c90 tempest-VolumesTransfersTest-1062377679 None] Lock "cinder-quobyte-278a3ae9-b998-4b35-8297-a4facbb1ea64" released by "delete_volume" :: held 1.513s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-88876493-987b-41c2-b058-e53a728669d6 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:20:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-88876493-987b-41c2-b058-e53a728669d6 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-88876493-987b-41c2-b058-e53a728669d6 tempest-VolumesSnapshotTestJSON-1056995611 None] Creating offline snapshot 2d807802-20bf-40d4-9360-6e5f17c46a33 of volume 58dc44e7-797a-4fa9-b2f7-712330a4f79c {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:20:31 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b135f0-fd85-42c1-98bb-46a29f902a47]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88876493-987b-41c2-b058-e53a728669d6 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:31 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-22e369b6-8206-40e7-92b2-c5623c3f9c90 tempest-VolumesTransfersTest-1062377679 None] Created reservations ['2dcd4910-9a27-4445-9057-53a474cb5214', 'cf60a3bb-57a0-44d5-b852-ee73d7b3042b', 'fb2cb3db-a3a6-4d9e-b02a-90a06767de1c', 'cfb87ab8-46e4-43be-8d59-ce605a3600ba'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:20:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-22e369b6-8206-40e7-92b2-c5623c3f9c90 tempest-VolumesTransfersTest-1062377679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:20:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-22e369b6-8206-40e7-92b2-c5623c3f9c90 tempest-VolumesTransfersTest-1062377679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-22e369b6-8206-40e7-92b2-c5623c3f9c90 tempest-VolumesTransfersTest-1062377679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:20:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-22e369b6-8206-40e7-92b2-c5623c3f9c90 tempest-VolumesTransfersTest-1062377679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:20:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-22e369b6-8206-40e7-92b2-c5623c3f9c90 tempest-VolumesTransfersTest-1062377679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-22e369b6-8206-40e7-92b2-c5623c3f9c90 tempest-VolumesTransfersTest-1062377679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:31 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:20:31 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:31 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c Jun 30 16:20:31 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:32 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:32 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-22e369b6-8206-40e7-92b2-c5623c3f9c90 tempest-VolumesTransfersTest-1062377679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.727s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:32 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-22e369b6-8206-40e7-92b2-c5623c3f9c90 tempest-VolumesTransfersTest-1062377679 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:20:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88876493-987b-41c2-b058-e53a728669d6 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c" returned: 0 in 0.821s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88876493-987b-41c2-b058-e53a728669d6 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.2d807802-20bf-40d4-9360-6e5f17c46a33 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:32 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-22e369b6-8206-40e7-92b2-c5623c3f9c90 tempest-VolumesTransfersTest-1062377679 None] Deleted volume successfully. Jun 30 16:20:32 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.2d807802-20bf-40d4-9360-6e5f17c46a33 1G Jun 30 16:20:32 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:32 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-22e369b6-8206-40e7-92b2-c5623c3f9c90 tempest-VolumesTransfersTest-1062377679 None] Lock "cinder-278a3ae9-b998-4b35-8297-a4facbb1ea64-delete_volume" released by "delete_volume" :: held 2.518s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:20:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:20:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:20:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:20:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:33 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:20:33 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:33 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88876493-987b-41c2-b058-e53a728669d6 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.2d807802-20bf-40d4-9360-6e5f17c46a33 1G" returned: 0 in 0.912s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88876493-987b-41c2-b058-e53a728669d6 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.2d807802-20bf-40d4-9360-6e5f17c46a33 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:33 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.2d807802-20bf-40d4-9360-6e5f17c46a33 Jun 30 16:20:33 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:33 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.799s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:33 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:20:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:20:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 28 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:20:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:20:34 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=95,cinder:INSERT=38,cinder:UPDATE=113,cinder:DELETE=12 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:20:34 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88876493-987b-41c2-b058-e53a728669d6 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.2d807802-20bf-40d4-9360-6e5f17c46a33" returned: 0 in 0.891s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:34 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-88876493-987b-41c2-b058-e53a728669d6 tempest-VolumesSnapshotTestJSON-1056995611 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.2d807802-20bf-40d4-9360-6e5f17c46a33 is being set with open permissions: ugo+rw Jun 30 16:20:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88876493-987b-41c2-b058-e53a728669d6 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.2d807802-20bf-40d4-9360-6e5f17c46a33 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:34 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.2d807802-20bf-40d4-9360-6e5f17c46a33 Jun 30 16:20:34 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:34 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88876493-987b-41c2-b058-e53a728669d6 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.2d807802-20bf-40d4-9360-6e5f17c46a33" returned: 0 in 0.785s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88876493-987b-41c2-b058-e53a728669d6 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:35 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.info Jun 30 16:20:35 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:35 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88876493-987b-41c2-b058-e53a728669d6 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.info" returned: 0 in 0.712s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:35 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-88876493-987b-41c2-b058-e53a728669d6 tempest-VolumesSnapshotTestJSON-1056995611 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.info is being set with open permissions: ugo+rw Jun 30 16:20:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88876493-987b-41c2-b058-e53a728669d6 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:35 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.info Jun 30 16:20:35 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:36 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88876493-987b-41c2-b058-e53a728669d6 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.info" returned: 0 in 0.675s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-88876493-987b-41c2-b058-e53a728669d6 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.895s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:36 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-88876493-987b-41c2-b058-e53a728669d6 tempest-VolumesSnapshotTestJSON-1056995611 None] Create snapshot completed successfully Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Flow 'volume_create_manager' (bcba52ae-0f16-4393-94f9-b8f165d777bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f16aa46-083f-4ce3-a4e7-042c645b3c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f16aa46-083f-4ce3-a4e7-042c645b3c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-452531594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9ad4057-6888-470e-aaa7-255766c40149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84840f58dc3f4285853db090b3507452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2d807802-20bf-40d4-9360-6e5f17c46a33,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:20:37Z,use_quota=True,user_id='7592a53d4232498ca6082ced67456e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8294fc39-12e4-4f76-82fc-aebcb9ecb16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8294fc39-12e4-4f76-82fc-aebcb9ecb16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36da9df-6b2c-494f-88bd-a78709df20c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36da9df-6b2c-494f-88bd-a78709df20c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e9ad4057-6888-470e-aaa7-255766c40149', 'volume_name': 'volume-e9ad4057-6888-470e-aaa7-255766c40149', 'volume_size': 1, 'snapshot_id': '2d807802-20bf-40d4-9360-6e5f17c46a33'}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb581124-9386-4e13-a640-99bffd126ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb581124-9386-4e13-a640-99bffd126ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61084189-e7d1-4929-9f7a-cb4e99b055e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:37 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Volume e9ad4057-6888-470e-aaa7-255766c40149: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e9ad4057-6888-470e-aaa7-255766c40149', 'volume_size': 1, 'snapshot_id': '2d807802-20bf-40d4-9360-6e5f17c46a33'} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "cinder-quobyte-2d807802-20bf-40d4-9360-6e5f17c46a33-e9ad4057-6888-470e-aaa7-255766c40149" by "_create_volume_from_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-2d807802-20bf-40d4-9360-6e5f17c46a33-e9ad4057-6888-470e-aaa7-255766c40149" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Creating volume e9ad4057-6888-470e-aaa7-255766c40149 from snapshot 2d807802-20bf-40d4-9360-6e5f17c46a33 {{(pid=93781) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "cinder-quobyte-e9ad4057-6888-470e-aaa7-255766c40149" by "_copy_volume_from_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-e9ad4057-6888-470e-aaa7-255766c40149" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] snapshot: 2d807802-20bf-40d4-9360-6e5f17c46a33, volume: e9ad4057-6888-470e-aaa7-255766c40149, {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a5e96d-27de-4895-9e0e-40c3b0c0789b]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.2d807802-20bf-40d4-9360-6e5f17c46a33 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:37 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.2d807802-20bf-40d4-9360-6e5f17c46a33 Jun 30 16:20:37 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:38 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.2d807802-20bf-40d4-9360-6e5f17c46a33" returned: 0 in 0.894s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:20:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] will copy from snapshot at /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 30 16:20:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Creating direct copy from snapshot {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 30 16:20:38 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a003f9-d79e-4ff7-9dfa-8cdf97a9699d]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:38 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c Jun 30 16:20:38 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:39 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c" returned: 0 in 0.859s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:39 devstack cinder-volume[93781]: DEBUG cinder.utils [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Path /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e9ad4057-6888-470e-aaa7-255766c40149 not found in is_blk_device check {{(pid=93781) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 30 16:20:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e9ad4057-6888-470e-aaa7-255766c40149 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:39 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e9ad4057-6888-470e-aaa7-255766c40149 Jun 30 16:20:39 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:44 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e9ad4057-6888-470e-aaa7-255766c40149" returned: 0 in 5.003s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:44 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c50d41-2934-43f6-b976-c496c4dd2e5d]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:44 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c Jun 30 16:20:44 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:45 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c" returned: 0 in 1.128s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:45 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Image conversion details: src /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c, size 1024.00 MB, duration 5.00 sec, destination /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e9ad4057-6888-470e-aaa7-255766c40149 {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:20:45 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Converted 1024.00 MB image at 204.64 MB/s Jun 30 16:20:45 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e9ad4057-6888-470e-aaa7-255766c40149 is being set with open permissions: ugo+rw Jun 30 16:20:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e9ad4057-6888-470e-aaa7-255766c40149 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:45 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e9ad4057-6888-470e-aaa7-255766c40149 Jun 30 16:20:45 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:46 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e9ad4057-6888-470e-aaa7-255766c40149" returned: 0 in 0.752s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:46 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-e9ad4057-6888-470e-aaa7-255766c40149" released by "_copy_volume_from_snapshot" :: held 8.739s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:46 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-2d807802-20bf-40d4-9360-6e5f17c46a33-e9ad4057-6888-470e-aaa7-255766c40149" released by "_create_volume_from_snapshot" :: held 8.777s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.793s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61084189-e7d1-4929-9f7a-cb4e99b055e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9ad4057-6888-470e-aaa7-255766c40149', 'volume_size': 1, 'snapshot_id': '2d807802-20bf-40d4-9360-6e5f17c46a33'}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92110b89-f436-46bf-a502-b51cc5d3d06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:20:46 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Volume volume-e9ad4057-6888-470e-aaa7-255766c40149 (e9ad4057-6888-470e-aaa7-255766c40149): created successfully Jun 30 16:20:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92110b89-f436-46bf-a502-b51cc5d3d06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:20:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Flow 'volume_create_manager' (bcba52ae-0f16-4393-94f9-b8f165d777bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:20:46 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-6d015a2c-1182-4642-b1c6-df3cff77da42 tempest-VolumesSnapshotTestJSON-1056995611 None] Created volume successfully. Jun 30 16:20:47 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e794a37f-e332-4ae7-90bc-8fde0b3f3254 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "cinder-e9ad4057-6888-470e-aaa7-255766c40149-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:47 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e794a37f-e332-4ae7-90bc-8fde0b3f3254 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-e9ad4057-6888-470e-aaa7-255766c40149-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:47 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e794a37f-e332-4ae7-90bc-8fde0b3f3254 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "cinder-quobyte-e9ad4057-6888-470e-aaa7-255766c40149" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:47 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e794a37f-e332-4ae7-90bc-8fde0b3f3254 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-e9ad4057-6888-470e-aaa7-255766c40149" acquired by "delete_volume" :: waited 0.020s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:47 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdb0c6d-ab3b-4f0e-bc2d-d15c66511469]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e794a37f-e332-4ae7-90bc-8fde0b3f3254 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e9ad4057-6888-470e-aaa7-255766c40149 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:47 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e9ad4057-6888-470e-aaa7-255766c40149 Jun 30 16:20:47 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:48 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e794a37f-e332-4ae7-90bc-8fde0b3f3254 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e9ad4057-6888-470e-aaa7-255766c40149" returned: 0 in 0.870s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e794a37f-e332-4ae7-90bc-8fde0b3f3254 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e9ad4057-6888-470e-aaa7-255766c40149 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:48 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e9ad4057-6888-470e-aaa7-255766c40149 Jun 30 16:20:48 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:49 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e794a37f-e332-4ae7-90bc-8fde0b3f3254 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e9ad4057-6888-470e-aaa7-255766c40149" returned: 0 in 0.656s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:49 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e794a37f-e332-4ae7-90bc-8fde0b3f3254 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-e9ad4057-6888-470e-aaa7-255766c40149" released by "delete_volume" :: held 1.571s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:49 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-e794a37f-e332-4ae7-90bc-8fde0b3f3254 tempest-VolumesSnapshotTestJSON-1056995611 None] Created reservations ['4f4bc049-2cbd-4947-88b4-89c72d95d84e', 'cdd930f2-99b8-4d59-b57f-963c965b35b0', '63cc236a-5163-4357-94b7-b87bfe25831f', '4f144d7f-a03c-4799-8d47-694d5ca6a1db'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:20:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e794a37f-e332-4ae7-90bc-8fde0b3f3254 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:20:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e794a37f-e332-4ae7-90bc-8fde0b3f3254 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e794a37f-e332-4ae7-90bc-8fde0b3f3254 tempest-VolumesSnapshotTestJSON-1056995611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:20:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e794a37f-e332-4ae7-90bc-8fde0b3f3254 tempest-VolumesSnapshotTestJSON-1056995611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:20:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e794a37f-e332-4ae7-90bc-8fde0b3f3254 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e794a37f-e332-4ae7-90bc-8fde0b3f3254 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:49 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:20:49 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e5a7e1af-747b-48d3-8d6f-77ff8dcc986d tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "cinder-2d807802-20bf-40d4-9360-6e5f17c46a33-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e5a7e1af-747b-48d3-8d6f-77ff8dcc986d tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-2d807802-20bf-40d4-9360-6e5f17c46a33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e5a7e1af-747b-48d3-8d6f-77ff8dcc986d tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "cinder-quobyte-58dc44e7-797a-4fa9-b2f7-712330a4f79c" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e5a7e1af-747b-48d3-8d6f-77ff8dcc986d tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-58dc44e7-797a-4fa9-b2f7-712330a4f79c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e5a7e1af-747b-48d3-8d6f-77ff8dcc986d tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "cinder-quobyte-2d807802-20bf-40d4-9360-6e5f17c46a33" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e5a7e1af-747b-48d3-8d6f-77ff8dcc986d tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-2d807802-20bf-40d4-9360-6e5f17c46a33" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:50 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-e5a7e1af-747b-48d3-8d6f-77ff8dcc986d tempest-VolumesSnapshotTestJSON-1056995611 None] Deleting offline snapshot 2d807802-20bf-40d4-9360-6e5f17c46a33 of volume 58dc44e7-797a-4fa9-b2f7-712330a4f79c {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:20:50 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-e5a7e1af-747b-48d3-8d6f-77ff8dcc986d tempest-VolumesSnapshotTestJSON-1056995611 None] snapshot_file for this snap is: volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.2d807802-20bf-40d4-9360-6e5f17c46a33 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:20:50 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c2adf1-79ca-467f-8670-0997956d8092]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e5a7e1af-747b-48d3-8d6f-77ff8dcc986d tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.2d807802-20bf-40d4-9360-6e5f17c46a33 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:50 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.2d807802-20bf-40d4-9360-6e5f17c46a33 Jun 30 16:20:50 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:50 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e794a37f-e332-4ae7-90bc-8fde0b3f3254 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.858s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:50 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-e794a37f-e332-4ae7-90bc-8fde0b3f3254 tempest-VolumesSnapshotTestJSON-1056995611 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:20:50 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-e794a37f-e332-4ae7-90bc-8fde0b3f3254 tempest-VolumesSnapshotTestJSON-1056995611 None] Deleted volume successfully. Jun 30 16:20:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e794a37f-e332-4ae7-90bc-8fde0b3f3254 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-e9ad4057-6888-470e-aaa7-255766c40149-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:51 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e5a7e1af-747b-48d3-8d6f-77ff8dcc986d tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.2d807802-20bf-40d4-9360-6e5f17c46a33" returned: 0 in 0.832s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:51 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-e5a7e1af-747b-48d3-8d6f-77ff8dcc986d tempest-VolumesSnapshotTestJSON-1056995611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:20:51 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf21c54-4ce7-4453-abf4-3da126315b27]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e5a7e1af-747b-48d3-8d6f-77ff8dcc986d tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:51 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c Jun 30 16:20:51 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:51 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e5a7e1af-747b-48d3-8d6f-77ff8dcc986d tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c" returned: 0 in 0.810s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e5a7e1af-747b-48d3-8d6f-77ff8dcc986d tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.2d807802-20bf-40d4-9360-6e5f17c46a33 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:51 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.2d807802-20bf-40d4-9360-6e5f17c46a33 Jun 30 16:20:51 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:52 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e5a7e1af-747b-48d3-8d6f-77ff8dcc986d tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.2d807802-20bf-40d4-9360-6e5f17c46a33" returned: 0 in 0.849s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e5a7e1af-747b-48d3-8d6f-77ff8dcc986d tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.2d807802-20bf-40d4-9360-6e5f17c46a33 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:52 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.2d807802-20bf-40d4-9360-6e5f17c46a33 Jun 30 16:20:52 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:53 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e5a7e1af-747b-48d3-8d6f-77ff8dcc986d tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c.2d807802-20bf-40d4-9360-6e5f17c46a33" returned: 0 in 0.710s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:53 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e5a7e1af-747b-48d3-8d6f-77ff8dcc986d tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-2d807802-20bf-40d4-9360-6e5f17c46a33" released by "_delete_snapshot" :: held 3.322s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:53 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e5a7e1af-747b-48d3-8d6f-77ff8dcc986d tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-58dc44e7-797a-4fa9-b2f7-712330a4f79c" released by "delete_snapshot" :: held 3.361s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:53 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-e5a7e1af-747b-48d3-8d6f-77ff8dcc986d tempest-VolumesSnapshotTestJSON-1056995611 None] Created reservations ['80e589a6-4cbe-4d99-87d0-21c6bfd79535', '1d3d40bb-d24a-4e76-92e8-1602d62a2b93', 'd8dde8a6-ba20-484c-aed9-5f554d918a47', 'be609cbd-2909-4715-b160-a4fe72796a5e'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:20:53 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-e5a7e1af-747b-48d3-8d6f-77ff8dcc986d tempest-VolumesSnapshotTestJSON-1056995611 None] Delete snapshot completed successfully. Jun 30 16:20:53 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e5a7e1af-747b-48d3-8d6f-77ff8dcc986d tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-2d807802-20bf-40d4-9360-6e5f17c46a33-delete_snapshot" released by "delete_snapshot" :: held 3.546s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8ab16b94-2c25-403b-8780-8c744b43369d tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "cinder-58dc44e7-797a-4fa9-b2f7-712330a4f79c-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8ab16b94-2c25-403b-8780-8c744b43369d tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-58dc44e7-797a-4fa9-b2f7-712330a4f79c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8ab16b94-2c25-403b-8780-8c744b43369d tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "cinder-quobyte-58dc44e7-797a-4fa9-b2f7-712330a4f79c" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8ab16b94-2c25-403b-8780-8c744b43369d tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-58dc44e7-797a-4fa9-b2f7-712330a4f79c" acquired by "delete_volume" :: waited 0.020s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:54 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02b5c12-fbbd-41d6-8e21-ee84f9c9c5b5]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8ab16b94-2c25-403b-8780-8c744b43369d tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:54 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c Jun 30 16:20:54 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:55 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8ab16b94-2c25-403b-8780-8c744b43369d tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c" returned: 0 in 0.837s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8ab16b94-2c25-403b-8780-8c744b43369d tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:55 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c Jun 30 16:20:55 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:56 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8ab16b94-2c25-403b-8780-8c744b43369d tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-58dc44e7-797a-4fa9-b2f7-712330a4f79c" returned: 0 in 0.786s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8ab16b94-2c25-403b-8780-8c744b43369d tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-58dc44e7-797a-4fa9-b2f7-712330a4f79c" released by "delete_volume" :: held 1.693s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:56 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-8ab16b94-2c25-403b-8780-8c744b43369d tempest-VolumesSnapshotTestJSON-1056995611 None] Created reservations ['86bc3dda-946b-4131-a604-374fdff1abe7', '79ecef55-ed6a-468c-9464-ba22ed290e8b', 'd5ab8fb9-0aba-4817-804d-23b5f9048395', '8715b088-8c86-4b20-8b8b-ab7a226a7a57'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:20:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8ab16b94-2c25-403b-8780-8c744b43369d tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:20:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8ab16b94-2c25-403b-8780-8c744b43369d tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:56 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-8ab16b94-2c25-403b-8780-8c744b43369d tempest-VolumesSnapshotTestJSON-1056995611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:20:56 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-8ab16b94-2c25-403b-8780-8c744b43369d tempest-VolumesSnapshotTestJSON-1056995611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:20:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8ab16b94-2c25-403b-8780-8c744b43369d tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8ab16b94-2c25-403b-8780-8c744b43369d tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:56 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:20:56 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1122a248-2b65-42b7-8d60-b1d612793729 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "cinder-222e5cae-e4ce-4842-979a-956f5c79288a-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1122a248-2b65-42b7-8d60-b1d612793729 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-222e5cae-e4ce-4842-979a-956f5c79288a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1122a248-2b65-42b7-8d60-b1d612793729 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "cinder-quobyte-222e5cae-e4ce-4842-979a-956f5c79288a" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:20:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1122a248-2b65-42b7-8d60-b1d612793729 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-222e5cae-e4ce-4842-979a-956f5c79288a" acquired by "delete_volume" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:20:56 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f6c5d3-8842-40a8-bc5f-c777655b78ac]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:20:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1122a248-2b65-42b7-8d60-b1d612793729 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:57 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a Jun 30 16:20:57 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:57 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8ab16b94-2c25-403b-8780-8c744b43369d tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.904s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:57 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-8ab16b94-2c25-403b-8780-8c744b43369d tempest-VolumesSnapshotTestJSON-1056995611 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:20:57 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-8ab16b94-2c25-403b-8780-8c744b43369d tempest-VolumesSnapshotTestJSON-1056995611 None] Deleted volume successfully. Jun 30 16:20:57 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8ab16b94-2c25-403b-8780-8c744b43369d tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-58dc44e7-797a-4fa9-b2f7-712330a4f79c-delete_volume" released by "delete_volume" :: held 2.918s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:57 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1122a248-2b65-42b7-8d60-b1d612793729 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a" returned: 0 in 0.927s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1122a248-2b65-42b7-8d60-b1d612793729 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:57 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a Jun 30 16:20:57 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:58 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1122a248-2b65-42b7-8d60-b1d612793729 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-222e5cae-e4ce-4842-979a-956f5c79288a" returned: 0 in 0.804s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:58 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1122a248-2b65-42b7-8d60-b1d612793729 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-quobyte-222e5cae-e4ce-4842-979a-956f5c79288a" released by "delete_volume" :: held 1.840s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:20:58 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-1122a248-2b65-42b7-8d60-b1d612793729 tempest-VolumesSnapshotTestJSON-1056995611 None] Created reservations ['389d82ec-fe85-4bec-a8b2-cf9fc33d9d32', '0f503914-8c67-4ab2-868d-998998a069ea', 'd614bbf8-4751-4cd1-87ef-bd1946d54e41', 'e7fe64c2-0b21-426c-84b4-136c85678ce1'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:20:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1122a248-2b65-42b7-8d60-b1d612793729 tempest-VolumesSnapshotTestJSON-1056995611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:20:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1122a248-2b65-42b7-8d60-b1d612793729 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:20:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1122a248-2b65-42b7-8d60-b1d612793729 tempest-VolumesSnapshotTestJSON-1056995611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:20:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1122a248-2b65-42b7-8d60-b1d612793729 tempest-VolumesSnapshotTestJSON-1056995611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:20:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1122a248-2b65-42b7-8d60-b1d612793729 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:20:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1122a248-2b65-42b7-8d60-b1d612793729 tempest-VolumesSnapshotTestJSON-1056995611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:20:58 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:20:58 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:20:59 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Jun 30 16:20:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1122a248-2b65-42b7-8d60-b1d612793729 tempest-VolumesSnapshotTestJSON-1056995611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.753s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:20:59 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-1122a248-2b65-42b7-8d60-b1d612793729 tempest-VolumesSnapshotTestJSON-1056995611 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:20:59 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-1122a248-2b65-42b7-8d60-b1d612793729 tempest-VolumesSnapshotTestJSON-1056995611 None] Deleted volume successfully. Jun 30 16:20:59 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1122a248-2b65-42b7-8d60-b1d612793729 tempest-VolumesSnapshotTestJSON-1056995611 None] Lock "cinder-222e5cae-e4ce-4842-979a-956f5c79288a-delete_volume" released by "delete_volume" :: held 2.892s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:21:07 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:UPDATE=104,cinder:SELECT=83,cinder:INSERT=19,cinder:DELETE=3 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:21:07 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:21:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Flow 'volume_create_manager' (3edde748-556e-40f9-a6c3-a18deaa4c40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:21:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c3b93f-5a34-48de-b2ea-9afb3390ddef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c3b93f-5a34-48de-b2ea-9afb3390ddef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1869087717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5143835e-2e0b-4dc0-b3d4-9ef538f8b248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73be8793628449d9ca5759712e1fab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:21:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:21:07Z,use_quota=True,user_id='d0ec3ee38d5d41ceb59a2301bb0a782a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0edd420-4c90-4e9e-9011-91825325eb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0edd420-4c90-4e9e-9011-91825325eb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f567316e-7a10-49a5-a4ee-e5aae3ed54da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f567316e-7a10-49a5-a4ee-e5aae3ed54da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5143835e-2e0b-4dc0-b3d4-9ef538f8b248', 'volume_name': 'volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248', 'volume_size': 2}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51195f2a-cdec-4e97-94a0-c46486a1d5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51195f2a-cdec-4e97-94a0-c46486a1d5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7a81e9-8738-4344-bfad-308b2869306a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:07 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Volume 5143835e-2e0b-4dc0-b3d4-9ef538f8b248: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248', 'volume_size': 2} Jun 30 16:21:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:21:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:21:07 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1869087717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5143835e-2e0b-4dc0-b3d4-9ef538f8b248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b73be8793628449d9ca5759712e1fab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:21:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:21:07Z,use_quota=True,user_id='d0ec3ee38d5d41ceb59a2301bb0a782a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:21:07 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Creating volume 5143835e-2e0b-4dc0-b3d4-9ef538f8b248 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:21:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:21:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:21:07 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:21:07 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:21:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:21:07 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:21:07 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:21:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248 2147483648 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:07 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248 2147483648 Jun 30 16:21:07 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:08 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248 2147483648" returned: 0 in 1.038s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:08 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248 Jun 30 16:21:08 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:09 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248" returned: 0 in 0.692s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:09 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:21:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:21:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7a81e9-8738-4344-bfad-308b2869306a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248', 'volume_size': 2}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219456a6-81d2-4e43-b8d5-11cd52473427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:09 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Volume volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248 (5143835e-2e0b-4dc0-b3d4-9ef538f8b248): created successfully Jun 30 16:21:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219456a6-81d2-4e43-b8d5-11cd52473427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Flow 'volume_create_manager' (3edde748-556e-40f9-a6c3-a18deaa4c40b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:21:09 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-ce10713d-5d29-4012-ab7d-f2098945529a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Created volume successfully. Jun 30 16:21:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cce52328-cfb0-45ed-b200-bdf33d684089 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:21:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cce52328-cfb0-45ed-b200-bdf33d684089 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:21:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-cce52328-cfb0-45ed-b200-bdf33d684089 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Creating offline snapshot dd15eb0b-11fd-43cc-8c9d-5e397cef7f31 of volume 5143835e-2e0b-4dc0-b3d4-9ef538f8b248 {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:21:10 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fa1b77-a72a-43f6-9bd4-b7163863f706]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:21:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cce52328-cfb0-45ed-b200-bdf33d684089 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:10 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248 Jun 30 16:21:10 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:11 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cce52328-cfb0-45ed-b200-bdf33d684089 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248" returned: 0 in 0.989s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cce52328-cfb0-45ed-b200-bdf33d684089 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.dd15eb0b-11fd-43cc-8c9d-5e397cef7f31 2G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:11 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.dd15eb0b-11fd-43cc-8c9d-5e397cef7f31 2G Jun 30 16:21:11 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:12 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cce52328-cfb0-45ed-b200-bdf33d684089 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.dd15eb0b-11fd-43cc-8c9d-5e397cef7f31 2G" returned: 0 in 0.971s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cce52328-cfb0-45ed-b200-bdf33d684089 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.dd15eb0b-11fd-43cc-8c9d-5e397cef7f31 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:12 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.dd15eb0b-11fd-43cc-8c9d-5e397cef7f31 Jun 30 16:21:12 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:13 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cce52328-cfb0-45ed-b200-bdf33d684089 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.dd15eb0b-11fd-43cc-8c9d-5e397cef7f31" returned: 0 in 0.749s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:13 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-cce52328-cfb0-45ed-b200-bdf33d684089 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.dd15eb0b-11fd-43cc-8c9d-5e397cef7f31 is being set with open permissions: ugo+rw Jun 30 16:21:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cce52328-cfb0-45ed-b200-bdf33d684089 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.dd15eb0b-11fd-43cc-8c9d-5e397cef7f31 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:13 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.dd15eb0b-11fd-43cc-8c9d-5e397cef7f31 Jun 30 16:21:13 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:13 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cce52328-cfb0-45ed-b200-bdf33d684089 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.dd15eb0b-11fd-43cc-8c9d-5e397cef7f31" returned: 0 in 0.737s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cce52328-cfb0-45ed-b200-bdf33d684089 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:14 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.info Jun 30 16:21:14 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:14 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cce52328-cfb0-45ed-b200-bdf33d684089 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.info" returned: 0 in 0.743s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:14 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-cce52328-cfb0-45ed-b200-bdf33d684089 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.info is being set with open permissions: ugo+rw Jun 30 16:21:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cce52328-cfb0-45ed-b200-bdf33d684089 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:14 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.info Jun 30 16:21:14 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:15 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cce52328-cfb0-45ed-b200-bdf33d684089 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.info" returned: 0 in 0.644s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cce52328-cfb0-45ed-b200-bdf33d684089 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.921s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:21:15 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-cce52328-cfb0-45ed-b200-bdf33d684089 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Create snapshot completed successfully Jun 30 16:21:15 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-afe44fa3-020d-48ff-b21f-6708d96aa62a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Acquiring lock "cinder-dd15eb0b-11fd-43cc-8c9d-5e397cef7f31-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:21:15 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-afe44fa3-020d-48ff-b21f-6708d96aa62a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Lock "cinder-dd15eb0b-11fd-43cc-8c9d-5e397cef7f31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:21:15 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-afe44fa3-020d-48ff-b21f-6708d96aa62a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Acquiring lock "cinder-quobyte-5143835e-2e0b-4dc0-b3d4-9ef538f8b248" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:21:15 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-afe44fa3-020d-48ff-b21f-6708d96aa62a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Lock "cinder-quobyte-5143835e-2e0b-4dc0-b3d4-9ef538f8b248" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:21:15 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-afe44fa3-020d-48ff-b21f-6708d96aa62a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Acquiring lock "cinder-quobyte-dd15eb0b-11fd-43cc-8c9d-5e397cef7f31" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:21:15 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-afe44fa3-020d-48ff-b21f-6708d96aa62a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Lock "cinder-quobyte-dd15eb0b-11fd-43cc-8c9d-5e397cef7f31" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:21:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-afe44fa3-020d-48ff-b21f-6708d96aa62a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Deleting offline snapshot dd15eb0b-11fd-43cc-8c9d-5e397cef7f31 of volume 5143835e-2e0b-4dc0-b3d4-9ef538f8b248 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:21:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-afe44fa3-020d-48ff-b21f-6708d96aa62a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] snapshot_file for this snap is: volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.dd15eb0b-11fd-43cc-8c9d-5e397cef7f31 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:21:15 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[194b05eb-97db-4a54-9b2f-3beb7bf63f26]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:21:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-afe44fa3-020d-48ff-b21f-6708d96aa62a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.dd15eb0b-11fd-43cc-8c9d-5e397cef7f31 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:15 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.dd15eb0b-11fd-43cc-8c9d-5e397cef7f31 Jun 30 16:21:15 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:16 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-afe44fa3-020d-48ff-b21f-6708d96aa62a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.dd15eb0b-11fd-43cc-8c9d-5e397cef7f31" returned: 0 in 0.801s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:16 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-afe44fa3-020d-48ff-b21f-6708d96aa62a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:21:16 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[711b65c8-d8a3-476e-95e1-7051e20f98be]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:21:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-afe44fa3-020d-48ff-b21f-6708d96aa62a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:16 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248 Jun 30 16:21:16 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:17 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-afe44fa3-020d-48ff-b21f-6708d96aa62a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248" returned: 0 in 0.792s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-afe44fa3-020d-48ff-b21f-6708d96aa62a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.dd15eb0b-11fd-43cc-8c9d-5e397cef7f31 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:17 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.dd15eb0b-11fd-43cc-8c9d-5e397cef7f31 Jun 30 16:21:17 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:18 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-afe44fa3-020d-48ff-b21f-6708d96aa62a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.dd15eb0b-11fd-43cc-8c9d-5e397cef7f31" returned: 0 in 1.174s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-afe44fa3-020d-48ff-b21f-6708d96aa62a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.dd15eb0b-11fd-43cc-8c9d-5e397cef7f31 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:18 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.dd15eb0b-11fd-43cc-8c9d-5e397cef7f31 Jun 30 16:21:18 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:19 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-afe44fa3-020d-48ff-b21f-6708d96aa62a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248.dd15eb0b-11fd-43cc-8c9d-5e397cef7f31" returned: 0 in 0.749s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:19 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-afe44fa3-020d-48ff-b21f-6708d96aa62a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Lock "cinder-quobyte-dd15eb0b-11fd-43cc-8c9d-5e397cef7f31" released by "_delete_snapshot" :: held 3.627s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:21:19 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-afe44fa3-020d-48ff-b21f-6708d96aa62a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Lock "cinder-quobyte-5143835e-2e0b-4dc0-b3d4-9ef538f8b248" released by "delete_snapshot" :: held 3.658s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:21:19 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-afe44fa3-020d-48ff-b21f-6708d96aa62a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Created reservations ['e393cc8c-5958-414f-b36a-06f542de06e6', 'a1b2f33b-bf36-418d-b8dc-cfd3ce2c9f32', '45c43d11-6ce6-4f95-9c57-8301121f01af', '9d2cf043-7451-4fc4-8179-32a1a98938e9'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:21:19 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-afe44fa3-020d-48ff-b21f-6708d96aa62a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Delete snapshot completed successfully. Jun 30 16:21:19 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-afe44fa3-020d-48ff-b21f-6708d96aa62a tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Lock "cinder-dd15eb0b-11fd-43cc-8c9d-5e397cef7f31-delete_snapshot" released by "delete_snapshot" :: held 3.811s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:21:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4f783cb1-bc47-4711-be65-f4bba92a9b25 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Acquiring lock "cinder-5143835e-2e0b-4dc0-b3d4-9ef538f8b248-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:21:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4f783cb1-bc47-4711-be65-f4bba92a9b25 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Lock "cinder-5143835e-2e0b-4dc0-b3d4-9ef538f8b248-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:21:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4f783cb1-bc47-4711-be65-f4bba92a9b25 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Acquiring lock "cinder-quobyte-5143835e-2e0b-4dc0-b3d4-9ef538f8b248" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:21:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4f783cb1-bc47-4711-be65-f4bba92a9b25 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Lock "cinder-quobyte-5143835e-2e0b-4dc0-b3d4-9ef538f8b248" acquired by "delete_volume" :: waited 0.024s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:21:20 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2b267f-b799-4d05-a381-4007d0c25597]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:21:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4f783cb1-bc47-4711-be65-f4bba92a9b25 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:20 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248 Jun 30 16:21:20 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:21 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4f783cb1-bc47-4711-be65-f4bba92a9b25 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248" returned: 0 in 0.882s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4f783cb1-bc47-4711-be65-f4bba92a9b25 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:21 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248 Jun 30 16:21:21 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:21 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4f783cb1-bc47-4711-be65-f4bba92a9b25 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5143835e-2e0b-4dc0-b3d4-9ef538f8b248" returned: 0 in 0.749s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4f783cb1-bc47-4711-be65-f4bba92a9b25 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Lock "cinder-quobyte-5143835e-2e0b-4dc0-b3d4-9ef538f8b248" released by "delete_volume" :: held 1.726s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:21:22 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-4f783cb1-bc47-4711-be65-f4bba92a9b25 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Created reservations ['a5cd5489-11f2-4b01-8246-2fd9bdfa25c6', 'a194bea2-3bb4-46e6-8aaa-29e357ed5b5c', '05cd229d-f706-434c-bc9c-2462158e7b75', '0745ac76-de3e-4725-8d9b-3db90093eccf'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:21:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4f783cb1-bc47-4711-be65-f4bba92a9b25 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:21:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4f783cb1-bc47-4711-be65-f4bba92a9b25 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:21:22 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-4f783cb1-bc47-4711-be65-f4bba92a9b25 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:21:22 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-4f783cb1-bc47-4711-be65-f4bba92a9b25 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:21:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4f783cb1-bc47-4711-be65-f4bba92a9b25 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:21:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4f783cb1-bc47-4711-be65-f4bba92a9b25 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:22 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:21:22 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:22 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4f783cb1-bc47-4711-be65-f4bba92a9b25 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.835s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:22 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-4f783cb1-bc47-4711-be65-f4bba92a9b25 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:21:23 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-4f783cb1-bc47-4711-be65-f4bba92a9b25 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Deleted volume successfully. Jun 30 16:21:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4f783cb1-bc47-4711-be65-f4bba92a9b25 tempest-VolumesSnapshotNegativeTestJSON-2127335779 None] Lock "cinder-5143835e-2e0b-4dc0-b3d4-9ef538f8b248-delete_volume" released by "delete_volume" :: held 2.894s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:21:23 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:21:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Flow 'volume_create_manager' (1e9d1eb1-dac0-4820-aeee-12917179fe68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:21:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53314179-f723-42c8-9be4-276d6a01e5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53314179-f723-42c8-9be4-276d6a01e5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1649329180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a5d4f35-3c1d-4061-b0d3-c379f483dd7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeefabf104b2462396044019af387750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:21:23Z,use_quota=True,user_id='8fb77b4c65af4e50af7e571dc1f03e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5ae716-35d5-49d4-964f-df8adba91c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5ae716-35d5-49d4-964f-df8adba91c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d23714-ad3a-4831-972a-cedb98cf4288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d23714-ad3a-4831-972a-cedb98cf4288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a5d4f35-3c1d-4061-b0d3-c379f483dd7d', 'volume_name': 'volume-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12988ef-52fa-41e2-a035-8e224d2aff5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12988ef-52fa-41e2-a035-8e224d2aff5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83765c3a-93a2-4764-9838-f89cc35b8adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:23 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Volume 8a5d4f35-3c1d-4061-b0d3-c379f483dd7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d', 'volume_size': 1} Jun 30 16:21:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:21:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:21:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1649329180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a5d4f35-3c1d-4061-b0d3-c379f483dd7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeefabf104b2462396044019af387750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:21:23Z,use_quota=True,user_id='8fb77b4c65af4e50af7e571dc1f03e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:21:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Creating volume 8a5d4f35-3c1d-4061-b0d3-c379f483dd7d {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:21:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:21:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:21:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:21:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:21:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:21:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:21:23 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:21:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:23 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d 1073741824 Jun 30 16:21:23 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:24 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d 1073741824" returned: 0 in 1.068s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:24 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d Jun 30 16:21:24 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:24 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d" returned: 0 in 0.652s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:24 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:21:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:21:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83765c3a-93a2-4764-9838-f89cc35b8adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f1b47f-cee0-4cee-b747-a59a2f019104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:24 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Volume volume-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d (8a5d4f35-3c1d-4061-b0d3-c379f483dd7d): created successfully Jun 30 16:21:24 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f1b47f-cee0-4cee-b747-a59a2f019104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Flow 'volume_create_manager' (1e9d1eb1-dac0-4820-aeee-12917179fe68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:21:25 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-aa7c4b82-9f06-4942-a316-eb1737167566 tempest-TestMinimumBasicScenario-827136293 None] Created volume successfully. Jun 30 16:21:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-b16ab479-3fac-440d-ab20-c3da4268192c req-b1ec39e4-c5f7-40b4-bba0-20bff63b5982 tempest-TestMinimumBasicScenario-827136293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:21:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-b16ab479-3fac-440d-ab20-c3da4268192c req-b1ec39e4-c5f7-40b4-bba0-20bff63b5982 tempest-TestMinimumBasicScenario-827136293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:21:28 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe83da7-1be4-4486-ad07-872287390b8b]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:21:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-b16ab479-3fac-440d-ab20-c3da4268192c req-b1ec39e4-c5f7-40b4-bba0-20bff63b5982 tempest-TestMinimumBasicScenario-827136293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:28 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d Jun 30 16:21:28 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:29 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-b16ab479-3fac-440d-ab20-c3da4268192c req-b1ec39e4-c5f7-40b4-bba0-20bff63b5982 tempest-TestMinimumBasicScenario-827136293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d" returned: 0 in 0.979s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-b16ab479-3fac-440d-ab20-c3da4268192c req-b1ec39e4-c5f7-40b4-bba0-20bff63b5982 tempest-TestMinimumBasicScenario-827136293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.998s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:21:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-b16ab479-3fac-440d-ab20-c3da4268192c req-b1ec39e4-c5f7-40b4-bba0-20bff63b5982 tempest-TestMinimumBasicScenario-827136293 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a', 'name': 'volume-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6048f04a-52b6-49de-956d-a0ba42c69eb5', 'enforce_multipath': True} {{(pid=93781) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 30 16:21:29 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-b16ab479-3fac-440d-ab20-c3da4268192c req-b1ec39e4-c5f7-40b4-bba0-20bff63b5982 tempest-TestMinimumBasicScenario-827136293 None] attachment_update completed successfully. Jun 30 16:21:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:21:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:21:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:21:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:21:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:21:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:21:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:33 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:21:33 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:33 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.860s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:33 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:21:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:21:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 28 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:21:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:21:39 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=22,cinder:UPDATE=27,cinder:DELETE=1,cinder:INSERT=5 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:21:39 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=50,cinder:UPDATE=49,cinder:INSERT=17,cinder:DELETE=7 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:21:51 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:21:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Flow 'volume_create_manager' (bd3bdf53-5de6-4fcf-9ca6-9508076612f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:21:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a6b9d4-54a4-4ff3-b5ea-c24a2a6ebc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a6b9d4-54a4-4ff3-b5ea-c24a2a6ebc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-402891159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=405833e1-15e9-43d8-b13f-581a3052ac01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c167fa6170e34fa69a8cb04446c8e500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:21:52Z,use_quota=True,user_id='c1eba1136cdf4ce890651ab05d8f299c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bfab0c6e-2888-4626-b282-3612b599da79),volume_type_id=bfab0c6e-2888-4626-b282-3612b599da79)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0bb0b0-b036-4599-aa56-1c23bf592700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0bb0b0-b036-4599-aa56-1c23bf592700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff40809-7b6b-4492-afd1-42916c14da9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff40809-7b6b-4492-afd1-42916c14da9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '405833e1-15e9-43d8-b13f-581a3052ac01', 'volume_name': 'volume-405833e1-15e9-43d8-b13f-581a3052ac01', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98b041b-527c-41b8-a045-cba2ac741ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98b041b-527c-41b8-a045-cba2ac741ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5595bac-2fca-4136-b5d3-a94d7c5ea528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:51 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Volume 405833e1-15e9-43d8-b13f-581a3052ac01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-405833e1-15e9-43d8-b13f-581a3052ac01', 'volume_size': 1} Jun 30 16:21:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:21:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:21:51 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-402891159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=405833e1-15e9-43d8-b13f-581a3052ac01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c167fa6170e34fa69a8cb04446c8e500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:21:52Z,use_quota=True,user_id='c1eba1136cdf4ce890651ab05d8f299c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bfab0c6e-2888-4626-b282-3612b599da79),volume_type_id=bfab0c6e-2888-4626-b282-3612b599da79)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:21:51 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Creating volume 405833e1-15e9-43d8-b13f-581a3052ac01 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:21:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:21:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:21:51 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:21:51 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:21:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:21:51 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:21:51 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:21:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-405833e1-15e9-43d8-b13f-581a3052ac01 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:51 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-405833e1-15e9-43d8-b13f-581a3052ac01 1073741824 Jun 30 16:21:51 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:52 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:21:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Flow 'volume_create_manager' (52da88da-be9d-4125-9bee-b55703ecd286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:21:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a3ad6f3-3b0c-4643-ae40-2d19727cb9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a3ad6f3-3b0c-4643-ae40-2d19727cb9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-516758566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09202260-1670-41f4-b9b3-3b2c8dc46f86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c167fa6170e34fa69a8cb04446c8e500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:21:52Z,use_quota=True,user_id='c1eba1136cdf4ce890651ab05d8f299c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab580cdc-cf72-457e-b2de-97e56c988f33),volume_type_id=ab580cdc-cf72-457e-b2de-97e56c988f33)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6b4a86-e5a5-4f3e-9e38-ba7e8095de98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6b4a86-e5a5-4f3e-9e38-ba7e8095de98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96586b0-1649-438e-b7fe-03fd1c87022b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96586b0-1649-438e-b7fe-03fd1c87022b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09202260-1670-41f4-b9b3-3b2c8dc46f86', 'volume_name': 'volume-09202260-1670-41f4-b9b3-3b2c8dc46f86', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c4c488-2ff9-46a5-9c21-60c85991b584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c4c488-2ff9-46a5-9c21-60c85991b584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (612ed13f-b9a9-4ca7-a0ec-088b6fe94721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:52 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Volume 09202260-1670-41f4-b9b3-3b2c8dc46f86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09202260-1670-41f4-b9b3-3b2c8dc46f86', 'volume_size': 1} Jun 30 16:21:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:21:52 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:21:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Flow 'volume_create_manager' (0b3e730b-aabb-4628-9e8f-fafff1eabb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:21:52 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dceb9294-d628-43cc-b7f7-836b2068b2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-405833e1-15e9-43d8-b13f-581a3052ac01 1073741824" returned: 0 in 0.960s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dceb9294-d628-43cc-b7f7-836b2068b2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1335605915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e561b01-4d5c-47eb-a84d-63fc5aa0b760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c167fa6170e34fa69a8cb04446c8e500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:21:53Z,use_quota=True,user_id='c1eba1136cdf4ce890651ab05d8f299c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a8e78dd-d320-4abd-b53b-1105706c6bec),volume_type_id=8a8e78dd-d320-4abd-b53b-1105706c6bec)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7492dae-6350-4067-9bfe-742434ec115d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7492dae-6350-4067-9bfe-742434ec115d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:52 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12b9266-b1ba-4685-aae2-84c89d7ca684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:52 devstack cinder-volume[93781]: DEBUG cinder.image.glance [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Creating Keystone auth plugin from conf {{(pid=93781) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 30 16:21:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-405833e1-15e9-43d8-b13f-581a3052ac01 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:52 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-405833e1-15e9-43d8-b13f-581a3052ac01 Jun 30 16:21:52 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12b9266-b1ba-4685-aae2-84c89d7ca684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8e561b01-4d5c-47eb-a84d-63fc5aa0b760', 'volume_name': 'volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760', 'volume_size': 1, 'image_id': '36652ab4-c520-41ba-b40d-6ae566df7fa3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36652ab4-c520-41ba-b40d-6ae566df7fa3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1912545377', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c167fa6170e34fa69a8cb04446c8e500', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36652ab4-c520-41ba-b40d-6ae566df7fa3', 'created_at': datetime.datetime(2026, 6, 30, 14, 21, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 14, 21, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36652ab4-c520-41ba-b40d-6ae566df7fa3/file', 'properties': {}}, 'image_service': }' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebfe81c-0fff-4b0b-a604-f9b6406fc23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebfe81c-0fff-4b0b-a604-f9b6406fc23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6c1d03-3cdd-4f8d-89fe-c3939b19e52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:53 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Volume 8e561b01-4d5c-47eb-a84d-63fc5aa0b760: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760', 'volume_size': 1, 'image_id': '36652ab4-c520-41ba-b40d-6ae566df7fa3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36652ab4-c520-41ba-b40d-6ae566df7fa3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1912545377', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c167fa6170e34fa69a8cb04446c8e500', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36652ab4-c520-41ba-b40d-6ae566df7fa3', 'created_at': datetime.datetime(2026, 6, 30, 14, 21, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 14, 21, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36652ab4-c520-41ba-b40d-6ae566df7fa3/file', 'properties': {}}, 'image_service': } Jun 30 16:21:53 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Trying to clone 8e561b01-4d5c-47eb-a84d-63fc5aa0b760 from image 36652ab4-c520-41ba-b40d-6ae566df7fa3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/36652ab4-c520-41ba-b40d-6ae566df7fa3', 'metadata': {}}]). {{(pid=93781) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 30 16:21:53 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-405833e1-15e9-43d8-b13f-581a3052ac01" returned: 0 in 0.683s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:21:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:21:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.327s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:21:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-516758566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09202260-1670-41f4-b9b3-3b2c8dc46f86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c167fa6170e34fa69a8cb04446c8e500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:21:52Z,use_quota=True,user_id='c1eba1136cdf4ce890651ab05d8f299c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab580cdc-cf72-457e-b2de-97e56c988f33),volume_type_id=ab580cdc-cf72-457e-b2de-97e56c988f33)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:21:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Creating volume 09202260-1670-41f4-b9b3-3b2c8dc46f86 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:21:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:21:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:21:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:21:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:21:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:21:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:21:53 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:21:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-09202260-1670-41f4-b9b3-3b2c8dc46f86 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5595bac-2fca-4136-b5d3-a94d7c5ea528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-405833e1-15e9-43d8-b13f-581a3052ac01', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:53 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-09202260-1670-41f4-b9b3-3b2c8dc46f86 1073741824 Jun 30 16:21:53 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3f1af3-d2a2-4bd8-8e46-6234d853572d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:53 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Volume volume-405833e1-15e9-43d8-b13f-581a3052ac01 (405833e1-15e9-43d8-b13f-581a3052ac01): created successfully Jun 30 16:21:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3f1af3-d2a2-4bd8-8e46-6234d853572d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Flow 'volume_create_manager' (bd3bdf53-5de6-4fcf-9ca6-9508076612f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:21:53 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-355e4cb1-016c-4f75-a608-37258a275ec1 tempest-TestInstancesWithCinderVolumes-726324571 None] Created volume successfully. Jun 30 16:21:54 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-09202260-1670-41f4-b9b3-3b2c8dc46f86 1073741824" returned: 0 in 1.019s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-09202260-1670-41f4-b9b3-3b2c8dc46f86 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:54 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-09202260-1670-41f4-b9b3-3b2c8dc46f86 Jun 30 16:21:54 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:55 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-09202260-1670-41f4-b9b3-3b2c8dc46f86" returned: 0 in 0.768s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:55 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:21:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:21:55 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (612ed13f-b9a9-4ca7-a0ec-088b6fe94721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09202260-1670-41f4-b9b3-3b2c8dc46f86', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:55 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb3b642-0d8a-46d2-97a5-3426796647ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:21:55 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Volume volume-09202260-1670-41f4-b9b3-3b2c8dc46f86 (09202260-1670-41f4-b9b3-3b2c8dc46f86): created successfully Jun 30 16:21:55 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb3b642-0d8a-46d2-97a5-3426796647ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:21:55 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Flow 'volume_create_manager' (52da88da-be9d-4125-9bee-b55703ecd286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:21:55 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-182388be-5c7f-462d-885f-6bf40f52a024 tempest-TestInstancesWithCinderVolumes-726324571 None] Created volume successfully. Jun 30 16:21:56 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_36652ab4-c520-41ba-b40d-6ae566df7fa3_0jxqxc0qdevstack@QuobyteHD, size 20.69 MB, duration 3.40 sec {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 30 16:21:56 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Image download 20.69 MB at 6.08 MB/s Jun 30 16:21:56 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ebbe42-237c-409b-b374-570f1261dd94]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:21:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36652ab4-c520-41ba-b40d-6ae566df7fa3_0jxqxc0qdevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:56 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36652ab4-c520-41ba-b40d-6ae566df7fa3_0jxqxc0qdevstack@QuobyteHD Jun 30 16:21:56 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:57 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36652ab4-c520-41ba-b40d-6ae566df7fa3_0jxqxc0qdevstack@QuobyteHD" returned: 0 in 0.820s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:57 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Temporary image 36652ab4-c520-41ba-b40d-6ae566df7fa3 is fetched for user c1eba1136cdf4ce890651ab05d8f299c. {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 30 16:21:57 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f01a22a-fccd-46bd-b06b-9e92a3103e0c]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:21:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36652ab4-c520-41ba-b40d-6ae566df7fa3_0jxqxc0qdevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:57 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36652ab4-c520-41ba-b40d-6ae566df7fa3_0jxqxc0qdevstack@QuobyteHD Jun 30 16:21:57 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:58 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36652ab4-c520-41ba-b40d-6ae566df7fa3_0jxqxc0qdevstack@QuobyteHD" returned: 0 in 0.796s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:21:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:21:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1335605915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e561b01-4d5c-47eb-a84d-63fc5aa0b760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c167fa6170e34fa69a8cb04446c8e500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:21:53Z,use_quota=True,user_id='c1eba1136cdf4ce890651ab05d8f299c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a8e78dd-d320-4abd-b53b-1105706c6bec),volume_type_id=8a8e78dd-d320-4abd-b53b-1105706c6bec)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:21:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Creating volume 8e561b01-4d5c-47eb-a84d-63fc5aa0b760 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:21:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:21:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:21:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:21:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:21:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:21:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:21:58 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:21:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:58 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 1073741824 Jun 30 16:21:58 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:21:59 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Jun 30 16:21:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 1073741824" returned: 0 in 0.969s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:21:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:21:59 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 Jun 30 16:21:59 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:22:00 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Jun 30 16:22:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760" returned: 0 in 0.894s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:22:00 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] <== create_volume: return (1945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:22:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:22:00 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Attempting download of 36652ab4-c520-41ba-b40d-6ae566df7fa3 ((None, [{'url': 'file:///opt/stack/data/glance/images/36652ab4-c520-41ba-b40d-6ae566df7fa3', 'metadata': {}}])) to volume 8e561b01-4d5c-47eb-a84d-63fc5aa0b760. {{(pid=93781) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 30 16:22:00 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11002be-60f7-41d0-b682-1c69f82eab34]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:22:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36652ab4-c520-41ba-b40d-6ae566df7fa3_u3fvtb8h {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:22:00 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36652ab4-c520-41ba-b40d-6ae566df7fa3_u3fvtb8h Jun 30 16:22:00 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:22:00 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Jun 30 16:22:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36652ab4-c520-41ba-b40d-6ae566df7fa3_u3fvtb8h" returned: 0 in 0.775s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:22:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36652ab4-c520-41ba-b40d-6ae566df7fa3_u3fvtb8h {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:22:01 devstack sudo[108582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36652ab4-c520-41ba-b40d-6ae566df7fa3_u3fvtb8h Jun 30 16:22:01 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:22:01 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root Jun 30 16:22:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36652ab4-c520-41ba-b40d-6ae566df7fa3_u3fvtb8h" returned: 1 in 0.777s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:22:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36652ab4-c520-41ba-b40d-6ae566df7fa3_u3fvtb8h' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:22:01 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec331f4-907f-4931-901c-bc9591d5b189]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:22:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36652ab4-c520-41ba-b40d-6ae566df7fa3_0jxqxc0qdevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:22:01 devstack sudo[108587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36652ab4-c520-41ba-b40d-6ae566df7fa3_0jxqxc0qdevstack@QuobyteHD Jun 30 16:22:01 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:22:02 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root Jun 30 16:22:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36652ab4-c520-41ba-b40d-6ae566df7fa3_0jxqxc0qdevstack@QuobyteHD" returned: 0 in 0.826s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:22:02 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] 36652ab4-c520-41ba-b40d-6ae566df7fa3 was qcow2, converting to raw {{(pid=93781) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 30 16:22:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36652ab4-c520-41ba-b40d-6ae566df7fa3_0jxqxc0qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:22:02 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36652ab4-c520-41ba-b40d-6ae566df7fa3_0jxqxc0qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 Jun 30 16:22:02 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:22:04 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Jun 30 16:22:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36652ab4-c520-41ba-b40d-6ae566df7fa3_0jxqxc0qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760" returned: 0 in 2.056s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:22:04 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_36652ab4-c520-41ba-b40d-6ae566df7fa3_0jxqxc0qdevstack@QuobyteHD, size 112.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:22:04 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Converted 112.00 MB image at 54.43 MB/s Jun 30 16:22:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:22:04 devstack sudo[108599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 1G Jun 30 16:22:04 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:22:05 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root Jun 30 16:22:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 1G" returned: 0 in 0.688s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:22:05 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b80af0-e776-4daa-bd66-7b1154b017b3]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:22:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:22:05 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 Jun 30 16:22:05 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:22:06 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Jun 30 16:22:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760" returned: 0 in 0.755s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:22:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:22:06 devstack sudo[108609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 Jun 30 16:22:06 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:22:06 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root Jun 30 16:22:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760" returned: 1 in 0.772s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:22:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:22:06 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Downloaded image 36652ab4-c520-41ba-b40d-6ae566df7fa3 ((None, [{'url': 'file:///opt/stack/data/glance/images/36652ab4-c520-41ba-b40d-6ae566df7fa3', 'metadata': {}}])) to volume 8e561b01-4d5c-47eb-a84d-63fc5aa0b760 successfully. {{(pid=93781) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 30 16:22:06 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Temporary image 36652ab4-c520-41ba-b40d-6ae566df7fa3 for user c1eba1136cdf4ce890651ab05d8f299c is deleted. {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 30 16:22:06 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Marking volume 8e561b01-4d5c-47eb-a84d-63fc5aa0b760 as bootable. {{(pid=93781) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 30 16:22:06 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Copying metadata from image 36652ab4-c520-41ba-b40d-6ae566df7fa3 to 8e561b01-4d5c-47eb-a84d-63fc5aa0b760. {{(pid=93781) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 30 16:22:06 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Creating volume glance metadata for volume 8e561b01-4d5c-47eb-a84d-63fc5aa0b760 backed by image 36652ab4-c520-41ba-b40d-6ae566df7fa3 with: {'image_id': '36652ab4-c520-41ba-b40d-6ae566df7fa3', 'image_name': 'tempest-scenario-img--1912545377', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93781) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 30 16:22:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6c1d03-3cdd-4f8d-89fe-c3939b19e52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760', 'volume_size': 1, 'image_id': '36652ab4-c520-41ba-b40d-6ae566df7fa3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36652ab4-c520-41ba-b40d-6ae566df7fa3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1912545377', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c167fa6170e34fa69a8cb04446c8e500', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36652ab4-c520-41ba-b40d-6ae566df7fa3', 'created_at': datetime.datetime(2026, 6, 30, 14, 21, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 14, 21, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36652ab4-c520-41ba-b40d-6ae566df7fa3/file', 'properties': {}}, 'image_service': }' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:22:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f71ef6-e52b-4eb5-930c-6770417a1683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:22:07 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Volume volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 (8e561b01-4d5c-47eb-a84d-63fc5aa0b760): created successfully Jun 30 16:22:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f71ef6-e52b-4eb5-930c-6770417a1683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:22:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Flow 'volume_create_manager' (0b3e730b-aabb-4628-9e8f-fafff1eabb9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:22:07 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-d20f7ee5-308b-4366-993f-a3c575603d15 tempest-TestInstancesWithCinderVolumes-726324571 None] Created volume successfully. Jun 30 16:22:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-4209768d-b5ed-4f31-a39e-56ccb70c93f7 req-bdb4d366-6f80-4b47-a919-5d28a4d41f37 tempest-TestInstancesWithCinderVolumes-726324571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:22:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-4209768d-b5ed-4f31-a39e-56ccb70c93f7 req-bdb4d366-6f80-4b47-a919-5d28a4d41f37 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:22:15 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bedb1fc-827a-4275-b0db-45392278ae05]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:22:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-4209768d-b5ed-4f31-a39e-56ccb70c93f7 req-bdb4d366-6f80-4b47-a919-5d28a4d41f37 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:22:15 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 Jun 30 16:22:15 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:22:15 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Jun 30 16:22:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-4209768d-b5ed-4f31-a39e-56ccb70c93f7 req-bdb4d366-6f80-4b47-a919-5d28a4d41f37 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760" returned: 0 in 0.753s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:22:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-4209768d-b5ed-4f31-a39e-56ccb70c93f7 req-bdb4d366-6f80-4b47-a919-5d28a4d41f37 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:22:16 devstack sudo[108672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 Jun 30 16:22:16 devstack sudo[108672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:22:16 devstack sudo[108672]: pam_unix(sudo:session): session closed for user root Jun 30 16:22:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-4209768d-b5ed-4f31-a39e-56ccb70c93f7 req-bdb4d366-6f80-4b47-a919-5d28a4d41f37 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760" returned: 1 in 0.771s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:22:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-4209768d-b5ed-4f31-a39e-56ccb70c93f7 req-bdb4d366-6f80-4b47-a919-5d28a4d41f37 tempest-TestInstancesWithCinderVolumes-726324571 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:22:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-4209768d-b5ed-4f31-a39e-56ccb70c93f7 req-bdb4d366-6f80-4b47-a919-5d28a4d41f37 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.571s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:22:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-4209768d-b5ed-4f31-a39e-56ccb70c93f7 req-bdb4d366-6f80-4b47-a919-5d28a4d41f37 tempest-TestInstancesWithCinderVolumes-726324571 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a', 'name': 'volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '655a15af-02ba-4a68-9261-3a0a0f29655d', 'enforce_multipath': True} {{(pid=93781) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 30 16:22:16 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-4209768d-b5ed-4f31-a39e-56ccb70c93f7 req-bdb4d366-6f80-4b47-a919-5d28a4d41f37 tempest-TestInstancesWithCinderVolumes-726324571 None] attachment_update completed successfully. Jun 30 16:22:26 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:UPDATE=12,cinder:SELECT=14,cinder:DELETE=2,cinder:INSERT=8 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:22:26 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=20,cinder:UPDATE=12,cinder:INSERT=4,cinder:DELETE=1 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:22:26 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-7b73e911-e09b-4c82-b6fe-8820b09da2c6 req-e3bab56b-92ea-4ec4-8518-8320d74d9d57 tempest-TestMinimumBasicScenario-827136293 None] Terminate volume connection completed successfully. Jun 30 16:22:26 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-7b73e911-e09b-4c82-b6fe-8820b09da2c6 req-e3bab56b-92ea-4ec4-8518-8320d74d9d57 tempest-TestMinimumBasicScenario-827136293 None] Deleting attachment 6048f04a-52b6-49de-956d-a0ba42c69eb5. {{(pid=93781) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 30 16:22:28 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1bb1353d-2eeb-472a-b789-a5a856d46c20 tempest-TestMinimumBasicScenario-827136293 None] Acquiring lock "cinder-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:22:28 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1bb1353d-2eeb-472a-b789-a5a856d46c20 tempest-TestMinimumBasicScenario-827136293 None] Lock "cinder-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:22:28 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1bb1353d-2eeb-472a-b789-a5a856d46c20 tempest-TestMinimumBasicScenario-827136293 None] Acquiring lock "cinder-quobyte-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:22:28 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1bb1353d-2eeb-472a-b789-a5a856d46c20 tempest-TestMinimumBasicScenario-827136293 None] Lock "cinder-quobyte-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d" acquired by "delete_volume" :: waited 0.026s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:22:29 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dfea27-fcbc-43c1-a487-62469d13be01]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:22:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1bb1353d-2eeb-472a-b789-a5a856d46c20 tempest-TestMinimumBasicScenario-827136293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:22:29 devstack sudo[108778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d Jun 30 16:22:29 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:22:30 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root Jun 30 16:22:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1bb1353d-2eeb-472a-b789-a5a856d46c20 tempest-TestMinimumBasicScenario-827136293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d" returned: 0 in 1.140s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:22:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1bb1353d-2eeb-472a-b789-a5a856d46c20 tempest-TestMinimumBasicScenario-827136293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:22:30 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d Jun 30 16:22:30 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:22:30 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Jun 30 16:22:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1bb1353d-2eeb-472a-b789-a5a856d46c20 tempest-TestMinimumBasicScenario-827136293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d" returned: 0 in 0.704s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:22:30 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1bb1353d-2eeb-472a-b789-a5a856d46c20 tempest-TestMinimumBasicScenario-827136293 None] Lock "cinder-quobyte-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d" released by "delete_volume" :: held 1.929s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:22:30 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-1bb1353d-2eeb-472a-b789-a5a856d46c20 tempest-TestMinimumBasicScenario-827136293 None] Created reservations ['39fc7661-18a4-410f-bdb9-5e9390bf4977', 'c647e724-e876-4310-84c3-e3180679bd30', 'b764a93e-118e-434d-8df1-e2c944977468', '4c954904-303f-4cb9-ae65-8d65572f5023'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:22:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1bb1353d-2eeb-472a-b789-a5a856d46c20 tempest-TestMinimumBasicScenario-827136293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:22:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1bb1353d-2eeb-472a-b789-a5a856d46c20 tempest-TestMinimumBasicScenario-827136293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:22:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1bb1353d-2eeb-472a-b789-a5a856d46c20 tempest-TestMinimumBasicScenario-827136293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:22:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1bb1353d-2eeb-472a-b789-a5a856d46c20 tempest-TestMinimumBasicScenario-827136293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:22:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1bb1353d-2eeb-472a-b789-a5a856d46c20 tempest-TestMinimumBasicScenario-827136293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:22:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1bb1353d-2eeb-472a-b789-a5a856d46c20 tempest-TestMinimumBasicScenario-827136293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:22:31 devstack sudo[108787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:22:31 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:22:31 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root Jun 30 16:22:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1bb1353d-2eeb-472a-b789-a5a856d46c20 tempest-TestMinimumBasicScenario-827136293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.901s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:22:31 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-1bb1353d-2eeb-472a-b789-a5a856d46c20 tempest-TestMinimumBasicScenario-827136293 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:22:31 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-1bb1353d-2eeb-472a-b789-a5a856d46c20 tempest-TestMinimumBasicScenario-827136293 None] Deleted volume successfully. Jun 30 16:22:32 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1bb1353d-2eeb-472a-b789-a5a856d46c20 tempest-TestMinimumBasicScenario-827136293 None] Lock "cinder-8a5d4f35-3c1d-4061-b0d3-c379f483dd7d-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:22:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:22:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:22:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:22:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:22:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:22:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:22:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:22:33 devstack sudo[108830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:22:33 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:22:34 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root Jun 30 16:22:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.258s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:22:34 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:22:34 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:22:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 28 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:22:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:22:42 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:22:44 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:22:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-ed1db399-5cf8-4a5a-ab23-709a16c7c331 req-da94f2ca-6de6-43ff-9450-cc9a21a4d0d1 tempest-TestInstancesWithCinderVolumes-726324571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:22:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-ed1db399-5cf8-4a5a-ab23-709a16c7c331 req-da94f2ca-6de6-43ff-9450-cc9a21a4d0d1 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:22:56 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b7a4c5-d8e4-4327-9722-2e4564eba3b3]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:22:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-ed1db399-5cf8-4a5a-ab23-709a16c7c331 req-da94f2ca-6de6-43ff-9450-cc9a21a4d0d1 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-405833e1-15e9-43d8-b13f-581a3052ac01 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:22:56 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-405833e1-15e9-43d8-b13f-581a3052ac01 Jun 30 16:22:56 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:22:57 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Jun 30 16:22:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-ed1db399-5cf8-4a5a-ab23-709a16c7c331 req-da94f2ca-6de6-43ff-9450-cc9a21a4d0d1 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-405833e1-15e9-43d8-b13f-581a3052ac01" returned: 0 in 0.817s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:22:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-ed1db399-5cf8-4a5a-ab23-709a16c7c331 req-da94f2ca-6de6-43ff-9450-cc9a21a4d0d1 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.840s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:22:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-ed1db399-5cf8-4a5a-ab23-709a16c7c331 req-da94f2ca-6de6-43ff-9450-cc9a21a4d0d1 tempest-TestInstancesWithCinderVolumes-726324571 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a', 'name': 'volume-405833e1-15e9-43d8-b13f-581a3052ac01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98e12baf-36a9-4bca-95a9-b873c8f22521', 'enforce_multipath': True} {{(pid=93781) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 30 16:22:57 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-ed1db399-5cf8-4a5a-ab23-709a16c7c331 req-da94f2ca-6de6-43ff-9450-cc9a21a4d0d1 tempest-TestInstancesWithCinderVolumes-726324571 None] attachment_update completed successfully. Jun 30 16:23:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-f96b2f00-a9d3-4910-acfc-011666b2d7c9 req-8d53dd00-530d-4ffb-a923-87c57b829a27 tempest-TestInstancesWithCinderVolumes-726324571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:23:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-f96b2f00-a9d3-4910-acfc-011666b2d7c9 req-8d53dd00-530d-4ffb-a923-87c57b829a27 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:23:05 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[f906cad8-6fd3-45a4-8463-08f1efa2d887]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:23:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-f96b2f00-a9d3-4910-acfc-011666b2d7c9 req-8d53dd00-530d-4ffb-a923-87c57b829a27 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-09202260-1670-41f4-b9b3-3b2c8dc46f86 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:23:05 devstack sudo[108963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-09202260-1670-41f4-b9b3-3b2c8dc46f86 Jun 30 16:23:05 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:23:06 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root Jun 30 16:23:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-f96b2f00-a9d3-4910-acfc-011666b2d7c9 req-8d53dd00-530d-4ffb-a923-87c57b829a27 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-09202260-1670-41f4-b9b3-3b2c8dc46f86" returned: 0 in 0.906s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:23:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-f96b2f00-a9d3-4910-acfc-011666b2d7c9 req-8d53dd00-530d-4ffb-a923-87c57b829a27 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.942s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:23:06 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-f96b2f00-a9d3-4910-acfc-011666b2d7c9 req-8d53dd00-530d-4ffb-a923-87c57b829a27 tempest-TestInstancesWithCinderVolumes-726324571 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a', 'name': 'volume-09202260-1670-41f4-b9b3-3b2c8dc46f86', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fad9183c-308d-463e-a32a-8fd2421d00d0', 'enforce_multipath': True} {{(pid=93781) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 30 16:23:06 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-f96b2f00-a9d3-4910-acfc-011666b2d7c9 req-8d53dd00-530d-4ffb-a923-87c57b829a27 tempest-TestInstancesWithCinderVolumes-726324571 None] attachment_update completed successfully. Jun 30 16:23:16 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=14,cinder:UPDATE=2 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:23:16 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:23:17 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-8c6ce183-3d4c-4377-9a9b-35fb059e3b98 req-abdce804-3e96-4681-aca8-3136ce96569f tempest-TestInstancesWithCinderVolumes-726324571 None] Terminate volume connection completed successfully. Jun 30 16:23:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-8c6ce183-3d4c-4377-9a9b-35fb059e3b98 req-abdce804-3e96-4681-aca8-3136ce96569f tempest-TestInstancesWithCinderVolumes-726324571 None] Deleting attachment 98e12baf-36a9-4bca-95a9-b873c8f22521. {{(pid=93781) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 30 16:23:19 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-94ea73a1-8a0b-4366-bc50-2263f123c747 tempest-TestInstancesWithCinderVolumes-726324571 None] Acquiring lock "cinder-405833e1-15e9-43d8-b13f-581a3052ac01-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:23:19 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-94ea73a1-8a0b-4366-bc50-2263f123c747 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "cinder-405833e1-15e9-43d8-b13f-581a3052ac01-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:23:19 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-94ea73a1-8a0b-4366-bc50-2263f123c747 tempest-TestInstancesWithCinderVolumes-726324571 None] Acquiring lock "cinder-quobyte-405833e1-15e9-43d8-b13f-581a3052ac01" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:23:19 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-94ea73a1-8a0b-4366-bc50-2263f123c747 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "cinder-quobyte-405833e1-15e9-43d8-b13f-581a3052ac01" acquired by "delete_volume" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:23:19 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[3470ccc2-2dc5-4e1d-aa3a-bc68042a0f40]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:23:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-94ea73a1-8a0b-4366-bc50-2263f123c747 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-405833e1-15e9-43d8-b13f-581a3052ac01 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:23:19 devstack sudo[109056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-405833e1-15e9-43d8-b13f-581a3052ac01 Jun 30 16:23:19 devstack sudo[109056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:23:20 devstack sudo[109056]: pam_unix(sudo:session): session closed for user root Jun 30 16:23:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-94ea73a1-8a0b-4366-bc50-2263f123c747 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-405833e1-15e9-43d8-b13f-581a3052ac01" returned: 0 in 0.983s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:23:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-94ea73a1-8a0b-4366-bc50-2263f123c747 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-405833e1-15e9-43d8-b13f-581a3052ac01 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:23:20 devstack sudo[109061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-405833e1-15e9-43d8-b13f-581a3052ac01 Jun 30 16:23:20 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:23:21 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root Jun 30 16:23:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-94ea73a1-8a0b-4366-bc50-2263f123c747 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-405833e1-15e9-43d8-b13f-581a3052ac01" returned: 0 in 0.853s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:23:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-94ea73a1-8a0b-4366-bc50-2263f123c747 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "cinder-quobyte-405833e1-15e9-43d8-b13f-581a3052ac01" released by "delete_volume" :: held 1.883s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:23:21 devstack cinder-volume[93781]: WARNING cinder.quota [None req-94ea73a1-8a0b-4366-bc50-2263f123c747 tempest-TestInstancesWithCinderVolumes-726324571 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2037985056-830268575 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2037985056-830268575, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:23:21 devstack cinder-volume[93781]: WARNING cinder.quota [None req-94ea73a1-8a0b-4366-bc50-2263f123c747 tempest-TestInstancesWithCinderVolumes-726324571 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2037985056-830268575 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2037985056-830268575, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:23:21 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-94ea73a1-8a0b-4366-bc50-2263f123c747 tempest-TestInstancesWithCinderVolumes-726324571 None] Created reservations ['21e5376d-ae09-4e35-b257-c7e28da0fccd', '59e02b46-33a4-44e8-9f97-9329e45bf8ae', '8f744e58-e3c1-4513-8e4e-c304732538ca', '535a0e62-1f8b-488d-bff2-ed59e4d225d1'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:23:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-94ea73a1-8a0b-4366-bc50-2263f123c747 tempest-TestInstancesWithCinderVolumes-726324571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:23:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-94ea73a1-8a0b-4366-bc50-2263f123c747 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:23:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-94ea73a1-8a0b-4366-bc50-2263f123c747 tempest-TestInstancesWithCinderVolumes-726324571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:23:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-94ea73a1-8a0b-4366-bc50-2263f123c747 tempest-TestInstancesWithCinderVolumes-726324571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:23:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-94ea73a1-8a0b-4366-bc50-2263f123c747 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:23:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-94ea73a1-8a0b-4366-bc50-2263f123c747 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:23:21 devstack sudo[109064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:23:21 devstack sudo[109064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:23:22 devstack sudo[109064]: pam_unix(sudo:session): session closed for user root Jun 30 16:23:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-94ea73a1-8a0b-4366-bc50-2263f123c747 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.841s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:23:22 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-94ea73a1-8a0b-4366-bc50-2263f123c747 tempest-TestInstancesWithCinderVolumes-726324571 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:23:22 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-94ea73a1-8a0b-4366-bc50-2263f123c747 tempest-TestInstancesWithCinderVolumes-726324571 None] Deleted volume successfully. Jun 30 16:23:22 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-94ea73a1-8a0b-4366-bc50-2263f123c747 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "cinder-405833e1-15e9-43d8-b13f-581a3052ac01-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:23:25 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-6a20fcb9-4a1b-4573-ab65-1f98c74b9338 req-25d4ff6d-43d1-4d3f-bbae-ff113eaa029c tempest-TestInstancesWithCinderVolumes-726324571 None] Terminate volume connection completed successfully. Jun 30 16:23:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-6a20fcb9-4a1b-4573-ab65-1f98c74b9338 req-25d4ff6d-43d1-4d3f-bbae-ff113eaa029c tempest-TestInstancesWithCinderVolumes-726324571 None] Deleting attachment fad9183c-308d-463e-a32a-8fd2421d00d0. {{(pid=93781) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 30 16:23:26 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4c5f3241-b80a-433a-9b71-fb092998d4cd tempest-TestInstancesWithCinderVolumes-726324571 None] Acquiring lock "cinder-09202260-1670-41f4-b9b3-3b2c8dc46f86-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:23:26 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4c5f3241-b80a-433a-9b71-fb092998d4cd tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "cinder-09202260-1670-41f4-b9b3-3b2c8dc46f86-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:23:27 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4c5f3241-b80a-433a-9b71-fb092998d4cd tempest-TestInstancesWithCinderVolumes-726324571 None] Acquiring lock "cinder-quobyte-09202260-1670-41f4-b9b3-3b2c8dc46f86" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:23:27 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4c5f3241-b80a-433a-9b71-fb092998d4cd tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "cinder-quobyte-09202260-1670-41f4-b9b3-3b2c8dc46f86" acquired by "delete_volume" :: waited 0.017s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:23:27 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[caffd173-319d-4112-95c4-8afc0dabfa58]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:23:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4c5f3241-b80a-433a-9b71-fb092998d4cd tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-09202260-1670-41f4-b9b3-3b2c8dc46f86 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:23:27 devstack sudo[109113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-09202260-1670-41f4-b9b3-3b2c8dc46f86 Jun 30 16:23:27 devstack sudo[109113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:23:28 devstack sudo[109113]: pam_unix(sudo:session): session closed for user root Jun 30 16:23:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4c5f3241-b80a-433a-9b71-fb092998d4cd tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-09202260-1670-41f4-b9b3-3b2c8dc46f86" returned: 0 in 0.905s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:23:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4c5f3241-b80a-433a-9b71-fb092998d4cd tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-09202260-1670-41f4-b9b3-3b2c8dc46f86 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:23:28 devstack sudo[109118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-09202260-1670-41f4-b9b3-3b2c8dc46f86 Jun 30 16:23:28 devstack sudo[109118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:23:28 devstack sudo[109118]: pam_unix(sudo:session): session closed for user root Jun 30 16:23:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4c5f3241-b80a-433a-9b71-fb092998d4cd tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-09202260-1670-41f4-b9b3-3b2c8dc46f86" returned: 0 in 0.947s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:23:28 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4c5f3241-b80a-433a-9b71-fb092998d4cd tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "cinder-quobyte-09202260-1670-41f4-b9b3-3b2c8dc46f86" released by "delete_volume" :: held 1.933s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:23:29 devstack cinder-volume[93781]: WARNING cinder.quota [None req-4c5f3241-b80a-433a-9b71-fb092998d4cd tempest-TestInstancesWithCinderVolumes-726324571 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1882950193-652986101 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1882950193-652986101, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:23:29 devstack cinder-volume[93781]: WARNING cinder.quota [None req-4c5f3241-b80a-433a-9b71-fb092998d4cd tempest-TestInstancesWithCinderVolumes-726324571 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1882950193-652986101 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1882950193-652986101, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:23:29 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-4c5f3241-b80a-433a-9b71-fb092998d4cd tempest-TestInstancesWithCinderVolumes-726324571 None] Created reservations ['082f3bea-76cc-4663-8cde-6ec205eaae4f', 'f579652a-88d7-4ba3-8ed0-285ce91504f4', '1846c2f0-9c67-4c98-8ac0-c9534c484b98', 'eaddc97c-af5e-4d2b-8362-375bdf337b9d'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:23:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4c5f3241-b80a-433a-9b71-fb092998d4cd tempest-TestInstancesWithCinderVolumes-726324571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:23:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4c5f3241-b80a-433a-9b71-fb092998d4cd tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:23:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-4c5f3241-b80a-433a-9b71-fb092998d4cd tempest-TestInstancesWithCinderVolumes-726324571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:23:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-4c5f3241-b80a-433a-9b71-fb092998d4cd tempest-TestInstancesWithCinderVolumes-726324571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:23:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-4c5f3241-b80a-433a-9b71-fb092998d4cd tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:23:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4c5f3241-b80a-433a-9b71-fb092998d4cd tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:23:29 devstack sudo[109125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:23:29 devstack sudo[109125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:23:30 devstack sudo[109125]: pam_unix(sudo:session): session closed for user root Jun 30 16:23:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-4c5f3241-b80a-433a-9b71-fb092998d4cd tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.871s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:23:30 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-4c5f3241-b80a-433a-9b71-fb092998d4cd tempest-TestInstancesWithCinderVolumes-726324571 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:23:30 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-4c5f3241-b80a-433a-9b71-fb092998d4cd tempest-TestInstancesWithCinderVolumes-726324571 None] Deleted volume successfully. Jun 30 16:23:30 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-4c5f3241-b80a-433a-9b71-fb092998d4cd tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "cinder-09202260-1670-41f4-b9b3-3b2c8dc46f86-delete_volume" released by "delete_volume" :: held 3.187s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:23:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:23:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:23:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:23:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:23:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:23:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:23:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:23:33 devstack sudo[109256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:23:33 devstack sudo[109256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:23:34 devstack sudo[109256]: pam_unix(sudo:session): session closed for user root Jun 30 16:23:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.981s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:23:34 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:23:34 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:23:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 28 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:23:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:23:34 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-11dda6f3-aaf7-41ef-81ce-ebce46211f74 req-8900f8e5-4cd9-4da0-bea1-afabbef04eef tempest-TestInstancesWithCinderVolumes-726324571 None] Terminate volume connection completed successfully. Jun 30 16:23:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-11dda6f3-aaf7-41ef-81ce-ebce46211f74 req-8900f8e5-4cd9-4da0-bea1-afabbef04eef tempest-TestInstancesWithCinderVolumes-726324571 None] Deleting attachment 655a15af-02ba-4a68-9261-3a0a0f29655d. {{(pid=93781) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 30 16:23:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] Acquiring lock "cinder-8e561b01-4d5c-47eb-a84d-63fc5aa0b760-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:23:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "cinder-8e561b01-4d5c-47eb-a84d-63fc5aa0b760-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:23:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] Acquiring lock "cinder-quobyte-8e561b01-4d5c-47eb-a84d-63fc5aa0b760" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:23:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "cinder-quobyte-8e561b01-4d5c-47eb-a84d-63fc5aa0b760" acquired by "delete_volume" :: waited 0.017s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:23:39 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc1a2ef-1de8-4b2a-aba7-7aa1af932250]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:23:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:23:39 devstack sudo[109263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 Jun 30 16:23:39 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:23:39 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root Jun 30 16:23:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760" returned: 0 in 0.768s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:23:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:23:40 devstack sudo[109267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 Jun 30 16:23:40 devstack sudo[109267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:23:40 devstack sudo[109267]: pam_unix(sudo:session): session closed for user root Jun 30 16:23:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760" returned: 1 in 0.814s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:23:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:23:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:23:40 devstack sudo[109272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760 Jun 30 16:23:40 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:23:41 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root Jun 30 16:23:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8e561b01-4d5c-47eb-a84d-63fc5aa0b760" returned: 0 in 0.663s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:23:41 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "cinder-quobyte-8e561b01-4d5c-47eb-a84d-63fc5aa0b760" released by "delete_volume" :: held 2.328s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:23:41 devstack cinder-volume[93781]: WARNING cinder.quota [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2067477311-2047346545 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2067477311-2047346545, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:23:41 devstack cinder-volume[93781]: WARNING cinder.quota [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2067477311-2047346545 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2067477311-2047346545, it is now deprecated. Please use the default quota class for default quota. Jun 30 16:23:41 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] Created reservations ['d4a33cbf-cfe4-4bc5-81c6-a676b80de403', 'fc6a7289-ba66-410c-9d6a-18512456be5b', '6184b37a-9cab-4b0e-a0da-66f4b3eea000', '37ca7515-dcec-473f-b017-2f9f0e3e17fc'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:23:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:23:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:23:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:23:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:23:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:23:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:23:41 devstack sudo[109275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:23:41 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:23:42 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root Jun 30 16:23:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.663s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:23:42 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:23:42 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] Deleted volume successfully. Jun 30 16:23:42 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-342fd037-ea87-4050-af73-9ab9f7a03d19 tempest-TestInstancesWithCinderVolumes-726324571 None] Lock "cinder-8e561b01-4d5c-47eb-a84d-63fc5aa0b760-delete_volume" released by "delete_volume" :: held 3.256s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:23:51 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=17,cinder:INSERT=6,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:23:52 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=19,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=2 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:23:57 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:23:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Flow 'volume_create_manager' (7a01d5e5-e677-4668-891d-d71a2f73ab7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:23:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e25e33-93a3-439d-94a5-d112f2efebdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:23:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e25e33-93a3-439d-94a5-d112f2efebdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1813616380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d56f7b3-3959-4cdb-ab7e-bdbca886ae06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc35a1f298c43288c3f21e932496c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:23:57Z,use_quota=True,user_id='8eaf319dbe81408db22b7dad1d935e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:23:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea1edfe5-2c13-4177-a60e-1337244022ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:23:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea1edfe5-2c13-4177-a60e-1337244022ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:23:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c4fefc3-f764-4065-83c6-bc01160d1160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:23:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c4fefc3-f764-4065-83c6-bc01160d1160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d56f7b3-3959-4cdb-ab7e-bdbca886ae06', 'volume_name': 'volume-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:23:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e7225d-d0d3-444b-87bd-cfbd017c6046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:23:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e7225d-d0d3-444b-87bd-cfbd017c6046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:23:57 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9569d2d-dd1c-4502-b2cf-75cfd1a78eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:23:57 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Volume 4d56f7b3-3959-4cdb-ab7e-bdbca886ae06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06', 'volume_size': 1} Jun 30 16:23:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:23:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:23:57 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1813616380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d56f7b3-3959-4cdb-ab7e-bdbca886ae06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc35a1f298c43288c3f21e932496c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:23:57Z,use_quota=True,user_id='8eaf319dbe81408db22b7dad1d935e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:23:57 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Creating volume 4d56f7b3-3959-4cdb-ab7e-bdbca886ae06 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:23:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:23:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:23:57 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:23:57 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:23:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:23:57 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:23:57 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:23:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:23:57 devstack sudo[109322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06 1073741824 Jun 30 16:23:57 devstack sudo[109322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:23:58 devstack sudo[109322]: pam_unix(sudo:session): session closed for user root Jun 30 16:23:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06 1073741824" returned: 0 in 1.088s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:23:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:23:58 devstack sudo[109327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06 Jun 30 16:23:58 devstack sudo[109327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:23:59 devstack sudo[109327]: pam_unix(sudo:session): session closed for user root Jun 30 16:23:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06" returned: 0 in 0.864s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:23:59 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:23:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:23:59 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9569d2d-dd1c-4502-b2cf-75cfd1a78eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:23:59 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05f84883-ad62-4089-9564-421b17f99c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:23:59 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Volume volume-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06 (4d56f7b3-3959-4cdb-ab7e-bdbca886ae06): created successfully Jun 30 16:23:59 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05f84883-ad62-4089-9564-421b17f99c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:23:59 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Flow 'volume_create_manager' (7a01d5e5-e677-4668-891d-d71a2f73ab7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:23:59 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-2f0b8ab0-e2be-44df-a639-393cdc1eb3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Created volume successfully. Jun 30 16:24:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-0d5325a5-20cb-40e5-9f79-778143a5aedb req-da3d863f-ac42-46f9-b2b4-0b08486d7bc3 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:24:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-0d5325a5-20cb-40e5-9f79-778143a5aedb req-da3d863f-ac42-46f9-b2b4-0b08486d7bc3 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:24:03 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[93043bdf-7538-4830-882f-a60b578ea8e1]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:24:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-0d5325a5-20cb-40e5-9f79-778143a5aedb req-da3d863f-ac42-46f9-b2b4-0b08486d7bc3 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:24:03 devstack sudo[109341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06 Jun 30 16:24:03 devstack sudo[109341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:24:04 devstack sudo[109341]: pam_unix(sudo:session): session closed for user root Jun 30 16:24:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-0d5325a5-20cb-40e5-9f79-778143a5aedb req-da3d863f-ac42-46f9-b2b4-0b08486d7bc3 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06" returned: 0 in 0.846s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:24:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-0d5325a5-20cb-40e5-9f79-778143a5aedb req-da3d863f-ac42-46f9-b2b4-0b08486d7bc3 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.877s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:24:04 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-0d5325a5-20cb-40e5-9f79-778143a5aedb req-da3d863f-ac42-46f9-b2b4-0b08486d7bc3 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a', 'name': 'volume-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49cf24c5-681c-46a5-85a5-1e46ac594f60', 'enforce_multipath': True} {{(pid=93781) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 30 16:24:04 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-0d5325a5-20cb-40e5-9f79-778143a5aedb req-da3d863f-ac42-46f9-b2b4-0b08486d7bc3 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] attachment_update completed successfully. Jun 30 16:24:13 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-64c414de-d5e4-43f8-a0c8-a27bcef83f00 req-08fe72ac-302d-411f-8346-d7d8817a8fb6 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Terminate volume connection completed successfully. Jun 30 16:24:13 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-64c414de-d5e4-43f8-a0c8-a27bcef83f00 req-08fe72ac-302d-411f-8346-d7d8817a8fb6 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Deleting attachment 49cf24c5-681c-46a5-85a5-1e46ac594f60. {{(pid=93781) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 30 16:24:15 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-48cfa65e-4718-4715-b263-1bf0afcc8a82 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Acquiring lock "cinder-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:24:15 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-48cfa65e-4718-4715-b263-1bf0afcc8a82 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Lock "cinder-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:24:15 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-48cfa65e-4718-4715-b263-1bf0afcc8a82 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Acquiring lock "cinder-quobyte-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:24:15 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-48cfa65e-4718-4715-b263-1bf0afcc8a82 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Lock "cinder-quobyte-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06" acquired by "delete_volume" :: waited 0.015s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:24:15 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[6643ff46-211e-44b9-9dbb-90465775d5e3]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:24:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-48cfa65e-4718-4715-b263-1bf0afcc8a82 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:24:15 devstack sudo[109801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06 Jun 30 16:24:15 devstack sudo[109801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:24:16 devstack sudo[109801]: pam_unix(sudo:session): session closed for user root Jun 30 16:24:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-48cfa65e-4718-4715-b263-1bf0afcc8a82 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06" returned: 0 in 0.907s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:24:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-48cfa65e-4718-4715-b263-1bf0afcc8a82 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:24:16 devstack sudo[109806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06 Jun 30 16:24:16 devstack sudo[109806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:24:16 devstack sudo[109806]: pam_unix(sudo:session): session closed for user root Jun 30 16:24:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-48cfa65e-4718-4715-b263-1bf0afcc8a82 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06" returned: 0 in 0.820s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:24:16 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-48cfa65e-4718-4715-b263-1bf0afcc8a82 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Lock "cinder-quobyte-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06" released by "delete_volume" :: held 1.773s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:24:17 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-48cfa65e-4718-4715-b263-1bf0afcc8a82 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Created reservations ['d0f9d047-3b56-4d4f-91a7-e02e984e1a40', '2e0ef092-56ec-4158-af5f-149f5496588e', '60c880b3-6129-4266-8929-94baa446f3a2', 'bbab0540-d2bd-4d02-bd4c-7a73e32af6aa'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:24:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-48cfa65e-4718-4715-b263-1bf0afcc8a82 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:24:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-48cfa65e-4718-4715-b263-1bf0afcc8a82 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:24:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-48cfa65e-4718-4715-b263-1bf0afcc8a82 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:24:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-48cfa65e-4718-4715-b263-1bf0afcc8a82 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:24:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-48cfa65e-4718-4715-b263-1bf0afcc8a82 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:24:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-48cfa65e-4718-4715-b263-1bf0afcc8a82 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:24:17 devstack sudo[109810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:24:17 devstack sudo[109810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:24:17 devstack sudo[109810]: pam_unix(sudo:session): session closed for user root Jun 30 16:24:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-48cfa65e-4718-4715-b263-1bf0afcc8a82 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.812s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:24:17 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-48cfa65e-4718-4715-b263-1bf0afcc8a82 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:24:17 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-48cfa65e-4718-4715-b263-1bf0afcc8a82 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Deleted volume successfully. Jun 30 16:24:17 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-48cfa65e-4718-4715-b263-1bf0afcc8a82 tempest-TestServerVolumeAttachScenarioOldVersion-1107762677 None] Lock "cinder-4d56f7b3-3959-4cdb-ab7e-bdbca886ae06-delete_volume" released by "delete_volume" :: held 2.817s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:24:22 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:24:22 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Flow 'volume_create_manager' (7012ff1a-8f10-4a2b-9d7e-113a697bb872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:24:22 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a3c183-d4ba-4798-9840-9d7e7a6351ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:24:22 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a3c183-d4ba-4798-9840-9d7e7a6351ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1464803596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765f8ff9-bc7c-42a0-9566-2df1f62b73d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a73a6fafb76483389232e00d5de252e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:24:22Z,use_quota=True,user_id='89868cdf3e1c4bed9287958cc0cb2c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:24:22 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d962fa-b5de-4667-b48b-4d93ef983c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:24:22 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d962fa-b5de-4667-b48b-4d93ef983c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:24:22 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f406e81-4009-4472-b089-741489f915cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:24:22 devstack cinder-volume[93781]: DEBUG cinder.image.glance [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Creating Keystone auth plugin from conf {{(pid=93781) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 30 16:24:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f406e81-4009-4472-b089-741489f915cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '765f8ff9-bc7c-42a0-9566-2df1f62b73d5', 'volume_name': 'volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5', 'volume_size': 1, 'image_id': '2303c773-75d0-4542-ba21-750c84d63b39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a85030669b0434f9a3a845e0c4388d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2303c773-75d0-4542-ba21-750c84d63b39', 'created_at': datetime.datetime(2026, 6, 30, 13, 59, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 13, 59, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2303c773-75d0-4542-ba21-750c84d63b39/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:24:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a9d2be-dd8d-47ae-94b0-c589bcc4254e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:24:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a9d2be-dd8d-47ae-94b0-c589bcc4254e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:24:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59a70d1-8df3-41fd-a64d-75c5908e2cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:24:23 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Volume 765f8ff9-bc7c-42a0-9566-2df1f62b73d5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5', 'volume_size': 1, 'image_id': '2303c773-75d0-4542-ba21-750c84d63b39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a85030669b0434f9a3a845e0c4388d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2303c773-75d0-4542-ba21-750c84d63b39', 'created_at': datetime.datetime(2026, 6, 30, 13, 59, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 13, 59, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2303c773-75d0-4542-ba21-750c84d63b39/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 30 16:24:23 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Trying to clone 765f8ff9-bc7c-42a0-9566-2df1f62b73d5 from image 2303c773-75d0-4542-ba21-750c84d63b39 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}]). {{(pid=93781) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 30 16:24:23 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_za509_awdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 30 16:24:23 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Image download 20.69 MB at 20.69 MB/s Jun 30 16:24:23 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[547ce848-c02f-4828-a9d9-37049df2ffc1]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:24:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_za509_awdevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:24:23 devstack sudo[109859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_za509_awdevstack@QuobyteHD Jun 30 16:24:23 devstack sudo[109859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:24:24 devstack sudo[109859]: pam_unix(sudo:session): session closed for user root Jun 30 16:24:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_za509_awdevstack@QuobyteHD" returned: 0 in 0.828s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:24:24 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Temporary image 2303c773-75d0-4542-ba21-750c84d63b39 is fetched for user 89868cdf3e1c4bed9287958cc0cb2c4d. {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 30 16:24:24 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccec20c-958e-49e0-8c8e-fb9313bf9f87]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:24:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_za509_awdevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:24:24 devstack sudo[109864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_za509_awdevstack@QuobyteHD Jun 30 16:24:24 devstack sudo[109864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:24:25 devstack sudo[109864]: pam_unix(sudo:session): session closed for user root Jun 30 16:24:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_za509_awdevstack@QuobyteHD" returned: 0 in 0.987s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:24:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:24:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:24:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1464803596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765f8ff9-bc7c-42a0-9566-2df1f62b73d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a73a6fafb76483389232e00d5de252e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:24:22Z,use_quota=True,user_id='89868cdf3e1c4bed9287958cc0cb2c4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:24:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Creating volume 765f8ff9-bc7c-42a0-9566-2df1f62b73d5 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:24:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:24:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:24:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:24:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:24:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:24:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:24:25 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:24:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:24:25 devstack sudo[109871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 1073741824 Jun 30 16:24:25 devstack sudo[109871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:24:26 devstack sudo[109871]: pam_unix(sudo:session): session closed for user root Jun 30 16:24:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 1073741824" returned: 0 in 0.897s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:24:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:24:26 devstack sudo[109877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 Jun 30 16:24:26 devstack sudo[109877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:24:27 devstack sudo[109877]: pam_unix(sudo:session): session closed for user root Jun 30 16:24:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5" returned: 0 in 0.738s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:24:27 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:24:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:24:27 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Attempting download of 2303c773-75d0-4542-ba21-750c84d63b39 ((None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}])) to volume 765f8ff9-bc7c-42a0-9566-2df1f62b73d5. {{(pid=93781) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 30 16:24:27 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f713da7-792a-4a75-a79b-103fb7df3003]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:24:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_5t1ogfd7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:24:27 devstack sudo[109881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_5t1ogfd7 Jun 30 16:24:27 devstack sudo[109881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:24:27 devstack sudo[109881]: pam_unix(sudo:session): session closed for user root Jun 30 16:24:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_5t1ogfd7" returned: 0 in 0.776s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:24:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_5t1ogfd7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:24:27 devstack sudo[109886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_5t1ogfd7 Jun 30 16:24:27 devstack sudo[109886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:24:28 devstack sudo[109886]: pam_unix(sudo:session): session closed for user root Jun 30 16:24:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_5t1ogfd7" returned: 1 in 0.762s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:24:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2303c773-75d0-4542-ba21-750c84d63b39_5t1ogfd7' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:24:28 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[42619b50-b703-4f85-871f-311a21b9878d]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:24:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_za509_awdevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:24:28 devstack sudo[109890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_za509_awdevstack@QuobyteHD Jun 30 16:24:28 devstack sudo[109890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:24:29 devstack sudo[109890]: pam_unix(sudo:session): session closed for user root Jun 30 16:24:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_za509_awdevstack@QuobyteHD" returned: 0 in 1.026s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:24:29 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] 2303c773-75d0-4542-ba21-750c84d63b39 was qcow2, converting to raw {{(pid=93781) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 30 16:24:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_za509_awdevstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:24:29 devstack sudo[109895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_za509_awdevstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 Jun 30 16:24:29 devstack sudo[109895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:24:32 devstack sudo[109895]: pam_unix(sudo:session): session closed for user root Jun 30 16:24:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_za509_awdevstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5" returned: 0 in 2.427s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:24:32 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2303c773-75d0-4542-ba21-750c84d63b39_za509_awdevstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:24:32 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Converted 112.00 MB image at 46.12 MB/s Jun 30 16:24:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:24:32 devstack sudo[109906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 1G Jun 30 16:24:32 devstack sudo[109906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:24:32 devstack sudo[109906]: pam_unix(sudo:session): session closed for user root Jun 30 16:24:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 1G" returned: 0 in 0.756s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:24:32 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f302a93-0605-4738-a637-aea80f58df7e]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:24:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:24:33 devstack sudo[109911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 Jun 30 16:24:33 devstack sudo[109911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:24:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:24:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:24:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:24:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:24:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:24:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:24:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:24:33 devstack sudo[109913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:24:33 devstack sudo[109913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:24:33 devstack sudo[109911]: pam_unix(sudo:session): session closed for user root Jun 30 16:24:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5" returned: 0 in 0.921s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:24:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:24:33 devstack sudo[109913]: pam_unix(sudo:session): session closed for user root Jun 30 16:24:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.815s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:24:33 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:24:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:24:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 28 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:24:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:24:33 devstack sudo[109918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 Jun 30 16:24:33 devstack sudo[109918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:24:34 devstack sudo[109918]: pam_unix(sudo:session): session closed for user root Jun 30 16:24:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5" returned: 1 in 0.814s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:24:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:24:34 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Downloaded image 2303c773-75d0-4542-ba21-750c84d63b39 ((None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}])) to volume 765f8ff9-bc7c-42a0-9566-2df1f62b73d5 successfully. {{(pid=93781) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 30 16:24:34 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Temporary image 2303c773-75d0-4542-ba21-750c84d63b39 for user 89868cdf3e1c4bed9287958cc0cb2c4d is deleted. {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 30 16:24:34 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Marking volume 765f8ff9-bc7c-42a0-9566-2df1f62b73d5 as bootable. {{(pid=93781) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 30 16:24:34 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Copying metadata from image 2303c773-75d0-4542-ba21-750c84d63b39 to 765f8ff9-bc7c-42a0-9566-2df1f62b73d5. {{(pid=93781) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 30 16:24:34 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Creating volume glance metadata for volume 765f8ff9-bc7c-42a0-9566-2df1f62b73d5 backed by image 2303c773-75d0-4542-ba21-750c84d63b39 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2303c773-75d0-4542-ba21-750c84d63b39', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93781) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 30 16:24:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59a70d1-8df3-41fd-a64d-75c5908e2cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5', 'volume_size': 1, 'image_id': '2303c773-75d0-4542-ba21-750c84d63b39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2303c773-75d0-4542-ba21-750c84d63b39', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3a85030669b0434f9a3a845e0c4388d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2303c773-75d0-4542-ba21-750c84d63b39', 'created_at': datetime.datetime(2026, 6, 30, 13, 59, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 13, 59, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2303c773-75d0-4542-ba21-750c84d63b39/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:24:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96fda63f-2471-4de6-9029-56a74a2e8535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:24:34 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Volume volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 (765f8ff9-bc7c-42a0-9566-2df1f62b73d5): created successfully Jun 30 16:24:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96fda63f-2471-4de6-9029-56a74a2e8535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:24:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Flow 'volume_create_manager' (7012ff1a-8f10-4a2b-9d7e-113a697bb872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:24:34 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-cf25077e-4b25-47ab-a5c1-2c43a0b0e741 tempest-TestShelveInstance-1682337060 None] Created volume successfully. Jun 30 16:24:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-4489393c-6bc7-46e6-bdaf-d2e9c93a35a2 req-dea3301b-6c67-4d12-add7-d5181ed24964 tempest-TestShelveInstance-1682337060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:24:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-4489393c-6bc7-46e6-bdaf-d2e9c93a35a2 req-dea3301b-6c67-4d12-add7-d5181ed24964 tempest-TestShelveInstance-1682337060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:24:42 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae66c81-66e2-4d86-9806-9a51e8478355]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:24:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-4489393c-6bc7-46e6-bdaf-d2e9c93a35a2 req-dea3301b-6c67-4d12-add7-d5181ed24964 tempest-TestShelveInstance-1682337060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:24:42 devstack sudo[109936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 Jun 30 16:24:42 devstack sudo[109936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:24:43 devstack sudo[109936]: pam_unix(sudo:session): session closed for user root Jun 30 16:24:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-4489393c-6bc7-46e6-bdaf-d2e9c93a35a2 req-dea3301b-6c67-4d12-add7-d5181ed24964 tempest-TestShelveInstance-1682337060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5" returned: 0 in 0.921s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:24:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-4489393c-6bc7-46e6-bdaf-d2e9c93a35a2 req-dea3301b-6c67-4d12-add7-d5181ed24964 tempest-TestShelveInstance-1682337060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:24:43 devstack sudo[109940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 Jun 30 16:24:43 devstack sudo[109940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:24:44 devstack sudo[109940]: pam_unix(sudo:session): session closed for user root Jun 30 16:24:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-4489393c-6bc7-46e6-bdaf-d2e9c93a35a2 req-dea3301b-6c67-4d12-add7-d5181ed24964 tempest-TestShelveInstance-1682337060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5" returned: 1 in 0.884s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:24:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-4489393c-6bc7-46e6-bdaf-d2e9c93a35a2 req-dea3301b-6c67-4d12-add7-d5181ed24964 tempest-TestShelveInstance-1682337060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:24:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-4489393c-6bc7-46e6-bdaf-d2e9c93a35a2 req-dea3301b-6c67-4d12-add7-d5181ed24964 tempest-TestShelveInstance-1682337060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.849s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:24:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-4489393c-6bc7-46e6-bdaf-d2e9c93a35a2 req-dea3301b-6c67-4d12-add7-d5181ed24964 tempest-TestShelveInstance-1682337060 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a', 'name': 'volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3fe81c7-88c0-43bd-9f3a-2f13e6964b7d', 'enforce_multipath': True} {{(pid=93781) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 30 16:24:44 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-4489393c-6bc7-46e6-bdaf-d2e9c93a35a2 req-dea3301b-6c67-4d12-add7-d5181ed24964 tempest-TestShelveInstance-1682337060 None] attachment_update completed successfully. Jun 30 16:24:54 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=26,cinder:UPDATE=22,cinder:INSERT=9,cinder:DELETE=1 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:24:54 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:UPDATE=16,cinder:SELECT=32,cinder:DELETE=2,cinder:INSERT=10 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:25:01 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:25:01 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Flow 'volume_create_manager' (e59c2311-1f84-4a67-b812-bc3ae75b5eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:25:01 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b9377ab-aab7-4a33-8e10-40f5ab2abda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:25:01 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b9377ab-aab7-4a33-8e10-40f5ab2abda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-576403141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9013402f-bb5b-4fee-9272-f35a27df9591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96cb98172e0047b0be19b47e67669228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:25:02Z,use_quota=True,user_id='87cab41a529d4c80a612567d09805b89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:25:01 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a56226a-81bd-4e00-bdb9-9ce9da79a44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:25:01 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a56226a-81bd-4e00-bdb9-9ce9da79a44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:25:01 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6adc3519-28e4-44cb-8c78-5bb85e085795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:25:01 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6adc3519-28e4-44cb-8c78-5bb85e085795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9013402f-bb5b-4fee-9272-f35a27df9591', 'volume_name': 'volume-9013402f-bb5b-4fee-9272-f35a27df9591', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:25:01 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31c7523f-c14a-4c19-8f5e-f9b23807b2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:25:01 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31c7523f-c14a-4c19-8f5e-f9b23807b2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:25:01 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38881403-66d0-4fd9-a9d4-441123830373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:25:01 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Volume 9013402f-bb5b-4fee-9272-f35a27df9591: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9013402f-bb5b-4fee-9272-f35a27df9591', 'volume_size': 1} Jun 30 16:25:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:25:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:25:01 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-576403141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9013402f-bb5b-4fee-9272-f35a27df9591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96cb98172e0047b0be19b47e67669228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:25:02Z,use_quota=True,user_id='87cab41a529d4c80a612567d09805b89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:25:01 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Creating volume 9013402f-bb5b-4fee-9272-f35a27df9591 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:25:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:25:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:25:01 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:25:01 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:25:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:25:01 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:25:01 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:25:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9013402f-bb5b-4fee-9272-f35a27df9591 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:25:01 devstack sudo[110422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9013402f-bb5b-4fee-9272-f35a27df9591 1073741824 Jun 30 16:25:01 devstack sudo[110422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:25:02 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:25:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Flow 'volume_create_manager' (6b4950dc-3998-44a3-ad4f-9c8c38ab94fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:25:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640a3374-036c-4d34-a899-fd0eddbfdcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:25:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640a3374-036c-4d34-a899-fd0eddbfdcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1010264512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee2df36-6a4a-42bc-8e16-198a96281b5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96cb98172e0047b0be19b47e67669228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:25:02Z,use_quota=True,user_id='87cab41a529d4c80a612567d09805b89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:25:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4540a4b8-0ac8-4b32-bf3e-6ab55f54bda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:25:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4540a4b8-0ac8-4b32-bf3e-6ab55f54bda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:25:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38a97d5-9d8e-4ce8-8360-956edbe4f48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:25:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38a97d5-9d8e-4ce8-8360-956edbe4f48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ee2df36-6a4a-42bc-8e16-198a96281b5d', 'volume_name': 'volume-7ee2df36-6a4a-42bc-8e16-198a96281b5d', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:25:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c5dcf4-cbf1-4c42-9829-b7a5a1008234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:25:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c5dcf4-cbf1-4c42-9829-b7a5a1008234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:25:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c126fb0-4f22-44d0-a163-9310fa749941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:25:02 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Volume 7ee2df36-6a4a-42bc-8e16-198a96281b5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ee2df36-6a4a-42bc-8e16-198a96281b5d', 'volume_size': 1} Jun 30 16:25:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:25:03 devstack sudo[110422]: pam_unix(sudo:session): session closed for user root Jun 30 16:25:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9013402f-bb5b-4fee-9272-f35a27df9591 1073741824" returned: 0 in 1.502s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:25:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9013402f-bb5b-4fee-9272-f35a27df9591 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:25:03 devstack sudo[110760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9013402f-bb5b-4fee-9272-f35a27df9591 Jun 30 16:25:03 devstack sudo[110760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:25:04 devstack sudo[110760]: pam_unix(sudo:session): session closed for user root Jun 30 16:25:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9013402f-bb5b-4fee-9272-f35a27df9591" returned: 0 in 0.769s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:25:04 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] <== create_volume: return (2327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:25:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.330s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:25:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.561s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:25:04 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1010264512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee2df36-6a4a-42bc-8e16-198a96281b5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96cb98172e0047b0be19b47e67669228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:25:02Z,use_quota=True,user_id='87cab41a529d4c80a612567d09805b89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:25:04 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Creating volume 7ee2df36-6a4a-42bc-8e16-198a96281b5d {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:25:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:25:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:25:04 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:25:04 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:25:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:25:04 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:25:04 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:25:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7ee2df36-6a4a-42bc-8e16-198a96281b5d 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:25:04 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38881403-66d0-4fd9-a9d4-441123830373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9013402f-bb5b-4fee-9272-f35a27df9591', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:25:04 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234fc9e5-2295-474e-95cf-b9ae1419581d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:25:04 devstack sudo[110763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7ee2df36-6a4a-42bc-8e16-198a96281b5d 1073741824 Jun 30 16:25:04 devstack sudo[110763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:25:04 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Volume volume-9013402f-bb5b-4fee-9272-f35a27df9591 (9013402f-bb5b-4fee-9272-f35a27df9591): created successfully Jun 30 16:25:04 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234fc9e5-2295-474e-95cf-b9ae1419581d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:25:04 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Flow 'volume_create_manager' (e59c2311-1f84-4a67-b812-bc3ae75b5eae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:25:04 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-104fc29a-9442-4d2a-ae1c-db3837ac169c tempest-TestServerVolumeAttachmentScenario-2072671812 None] Created volume successfully. Jun 30 16:25:05 devstack sudo[110763]: pam_unix(sudo:session): session closed for user root Jun 30 16:25:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7ee2df36-6a4a-42bc-8e16-198a96281b5d 1073741824" returned: 0 in 1.031s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:25:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7ee2df36-6a4a-42bc-8e16-198a96281b5d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:25:05 devstack sudo[110769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7ee2df36-6a4a-42bc-8e16-198a96281b5d Jun 30 16:25:05 devstack sudo[110769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:25:06 devstack sudo[110769]: pam_unix(sudo:session): session closed for user root Jun 30 16:25:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7ee2df36-6a4a-42bc-8e16-198a96281b5d" returned: 0 in 0.991s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:25:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] <== create_volume: return (2082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:25:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.089s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:25:06 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c126fb0-4f22-44d0-a163-9310fa749941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ee2df36-6a4a-42bc-8e16-198a96281b5d', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:25:06 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a401ec-25a6-497e-b579-22ccc06ab27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:25:06 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Volume volume-7ee2df36-6a4a-42bc-8e16-198a96281b5d (7ee2df36-6a4a-42bc-8e16-198a96281b5d): created successfully Jun 30 16:25:06 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a401ec-25a6-497e-b579-22ccc06ab27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:25:06 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Flow 'volume_create_manager' (6b4950dc-3998-44a3-ad4f-9c8c38ab94fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:25:06 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-d4b12366-3b10-4c57-818b-54bc16f1b39d tempest-TestServerVolumeAttachmentScenario-2072671812 None] Created volume successfully. Jun 30 16:25:16 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:25:16 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=2,cinder:DELETE=2 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:25:30 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-220e9dff-4936-4190-8bac-a1e1c95d776d req-e29d8ce7-5e58-4f65-a800-9522bc2684c0 tempest-TestShelveInstance-1682337060 None] Terminate volume connection completed successfully. Jun 30 16:25:30 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-220e9dff-4936-4190-8bac-a1e1c95d776d req-e29d8ce7-5e58-4f65-a800-9522bc2684c0 tempest-TestShelveInstance-1682337060 None] Deleting attachment a3fe81c7-88c0-43bd-9f3a-2f13e6964b7d. {{(pid=93781) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 30 16:25:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:25:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:25:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:25:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:25:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:25:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:25:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:25:33 devstack sudo[111168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:25:33 devstack sudo[111168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:25:34 devstack sudo[111168]: pam_unix(sudo:session): session closed for user root Jun 30 16:25:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.058s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:25:34 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:25:34 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:25:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 28 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:25:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:25:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-78a77b1c-8ead-452d-9a6d-30739c8ff6ce req-3f2daa35-9fe2-447a-9ced-5cf5ad2592fa tempest-TestShelveInstance-1682337060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:25:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-78a77b1c-8ead-452d-9a6d-30739c8ff6ce req-3f2daa35-9fe2-447a-9ced-5cf5ad2592fa tempest-TestShelveInstance-1682337060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:25:35 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3bf345-09f9-48ea-b382-f69856b5c6ef]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:25:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-78a77b1c-8ead-452d-9a6d-30739c8ff6ce req-3f2daa35-9fe2-447a-9ced-5cf5ad2592fa tempest-TestShelveInstance-1682337060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:25:35 devstack sudo[111199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 Jun 30 16:25:35 devstack sudo[111199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:25:36 devstack sudo[111199]: pam_unix(sudo:session): session closed for user root Jun 30 16:25:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-78a77b1c-8ead-452d-9a6d-30739c8ff6ce req-3f2daa35-9fe2-447a-9ced-5cf5ad2592fa tempest-TestShelveInstance-1682337060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5" returned: 0 in 0.807s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:25:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-78a77b1c-8ead-452d-9a6d-30739c8ff6ce req-3f2daa35-9fe2-447a-9ced-5cf5ad2592fa tempest-TestShelveInstance-1682337060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:25:36 devstack sudo[111203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 Jun 30 16:25:36 devstack sudo[111203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:25:37 devstack sudo[111203]: pam_unix(sudo:session): session closed for user root Jun 30 16:25:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-78a77b1c-8ead-452d-9a6d-30739c8ff6ce req-3f2daa35-9fe2-447a-9ced-5cf5ad2592fa tempest-TestShelveInstance-1682337060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5" returned: 1 in 0.795s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:25:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-78a77b1c-8ead-452d-9a6d-30739c8ff6ce req-3f2daa35-9fe2-447a-9ced-5cf5ad2592fa tempest-TestShelveInstance-1682337060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:25:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-78a77b1c-8ead-452d-9a6d-30739c8ff6ce req-3f2daa35-9fe2-447a-9ced-5cf5ad2592fa tempest-TestShelveInstance-1682337060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.650s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:25:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-78a77b1c-8ead-452d-9a6d-30739c8ff6ce req-3f2daa35-9fe2-447a-9ced-5cf5ad2592fa tempest-TestShelveInstance-1682337060 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a', 'name': 'volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '57dcbc0b-70b3-4f83-9a7f-67d80105f45c', 'enforce_multipath': True} {{(pid=93781) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 30 16:25:37 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-78a77b1c-8ead-452d-9a6d-30739c8ff6ce req-3f2daa35-9fe2-447a-9ced-5cf5ad2592fa tempest-TestShelveInstance-1682337060 None] attachment_update completed successfully. Jun 30 16:25:47 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=7 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:25:47 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:25:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-61b7ecc8-cbd7-4f8f-aa45-ff00824c0f5e req-45429b6d-bdc1-46a2-b546-4324910195fa tempest-TestServerVolumeAttachmentScenario-2072671812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:25:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-61b7ecc8-cbd7-4f8f-aa45-ff00824c0f5e req-45429b6d-bdc1-46a2-b546-4324910195fa tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:25:50 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[4185139f-0455-492e-80d4-1928d0ef03a6]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:25:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-61b7ecc8-cbd7-4f8f-aa45-ff00824c0f5e req-45429b6d-bdc1-46a2-b546-4324910195fa tempest-TestServerVolumeAttachmentScenario-2072671812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9013402f-bb5b-4fee-9272-f35a27df9591 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:25:50 devstack sudo[111692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9013402f-bb5b-4fee-9272-f35a27df9591 Jun 30 16:25:50 devstack sudo[111692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:25:51 devstack sudo[111692]: pam_unix(sudo:session): session closed for user root Jun 30 16:25:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-61b7ecc8-cbd7-4f8f-aa45-ff00824c0f5e req-45429b6d-bdc1-46a2-b546-4324910195fa tempest-TestServerVolumeAttachmentScenario-2072671812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9013402f-bb5b-4fee-9272-f35a27df9591" returned: 0 in 1.007s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:25:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-61b7ecc8-cbd7-4f8f-aa45-ff00824c0f5e req-45429b6d-bdc1-46a2-b546-4324910195fa tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.059s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:25:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-61b7ecc8-cbd7-4f8f-aa45-ff00824c0f5e req-45429b6d-bdc1-46a2-b546-4324910195fa tempest-TestServerVolumeAttachmentScenario-2072671812 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a', 'name': 'volume-9013402f-bb5b-4fee-9272-f35a27df9591', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2c97bf6-dfab-4c0c-9931-bdf1f8bca5ef', 'enforce_multipath': True} {{(pid=93781) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 30 16:25:51 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-61b7ecc8-cbd7-4f8f-aa45-ff00824c0f5e req-45429b6d-bdc1-46a2-b546-4324910195fa tempest-TestServerVolumeAttachmentScenario-2072671812 None] attachment_update completed successfully. Jun 30 16:26:01 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:26:01 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=7 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:26:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-8a759252-c44f-4718-a3e6-09bdace530e7 req-ca52bce5-6e92-40a9-929f-22629753023f tempest-TestServerVolumeAttachmentScenario-2072671812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:26:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-8a759252-c44f-4718-a3e6-09bdace530e7 req-ca52bce5-6e92-40a9-929f-22629753023f tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:26:01 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2ba3e3-9aca-4680-80ac-494838fb3e9f]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:26:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-8a759252-c44f-4718-a3e6-09bdace530e7 req-ca52bce5-6e92-40a9-929f-22629753023f tempest-TestServerVolumeAttachmentScenario-2072671812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7ee2df36-6a4a-42bc-8e16-198a96281b5d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:01 devstack sudo[111724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7ee2df36-6a4a-42bc-8e16-198a96281b5d Jun 30 16:26:01 devstack sudo[111724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:02 devstack sudo[111724]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-8a759252-c44f-4718-a3e6-09bdace530e7 req-ca52bce5-6e92-40a9-929f-22629753023f tempest-TestServerVolumeAttachmentScenario-2072671812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7ee2df36-6a4a-42bc-8e16-198a96281b5d" returned: 0 in 1.222s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-8a759252-c44f-4718-a3e6-09bdace530e7 req-ca52bce5-6e92-40a9-929f-22629753023f tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.256s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:26:03 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-8a759252-c44f-4718-a3e6-09bdace530e7 req-ca52bce5-6e92-40a9-929f-22629753023f tempest-TestServerVolumeAttachmentScenario-2072671812 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a', 'name': 'volume-7ee2df36-6a4a-42bc-8e16-198a96281b5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0fed54d-9fbd-4bf4-a033-82f84194d8a7', 'enforce_multipath': True} {{(pid=93781) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 30 16:26:03 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-8a759252-c44f-4718-a3e6-09bdace530e7 req-ca52bce5-6e92-40a9-929f-22629753023f tempest-TestServerVolumeAttachmentScenario-2072671812 None] attachment_update completed successfully. Jun 30 16:26:09 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-a7c8f779-28e0-47a6-8023-ee7a85ab88ea req-4f241ef6-d423-4e8c-8f19-d3cec2a1dae4 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Terminate volume connection completed successfully. Jun 30 16:26:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-a7c8f779-28e0-47a6-8023-ee7a85ab88ea req-4f241ef6-d423-4e8c-8f19-d3cec2a1dae4 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Deleting attachment f0fed54d-9fbd-4bf4-a033-82f84194d8a7. {{(pid=93781) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 30 16:26:13 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-04e8284b-62db-4ac8-89b3-110788faa9cf req-626cd0d0-8a0c-4123-819f-d72d83b7d4c8 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Terminate volume connection completed successfully. Jun 30 16:26:13 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-04e8284b-62db-4ac8-89b3-110788faa9cf req-626cd0d0-8a0c-4123-819f-d72d83b7d4c8 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Deleting attachment a2c97bf6-dfab-4c0c-9931-bdf1f8bca5ef. {{(pid=93781) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 30 16:26:19 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:26:21 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-f34e6e8b-07aa-44ff-8aac-247892d8cbf8 tempest-TestShelveInstance-1682337060 None] Terminate volume connection completed successfully. Jun 30 16:26:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-f34e6e8b-07aa-44ff-8aac-247892d8cbf8 tempest-TestShelveInstance-1682337060 None] Deleting attachment 57dcbc0b-70b3-4f83-9a7f-67d80105f45c. {{(pid=93781) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 30 16:26:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-44e3fa61-94a6-4c07-b713-c28e56804cc4 tempest-TestShelveInstance-1682337060 None] Acquiring lock "cinder-765f8ff9-bc7c-42a0-9566-2df1f62b73d5-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:26:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-44e3fa61-94a6-4c07-b713-c28e56804cc4 tempest-TestShelveInstance-1682337060 None] Lock "cinder-765f8ff9-bc7c-42a0-9566-2df1f62b73d5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:26:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-44e3fa61-94a6-4c07-b713-c28e56804cc4 tempest-TestShelveInstance-1682337060 None] Acquiring lock "cinder-quobyte-765f8ff9-bc7c-42a0-9566-2df1f62b73d5" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:26:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-44e3fa61-94a6-4c07-b713-c28e56804cc4 tempest-TestShelveInstance-1682337060 None] Lock "cinder-quobyte-765f8ff9-bc7c-42a0-9566-2df1f62b73d5" acquired by "delete_volume" :: waited 0.023s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:26:22 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbbe40e-c3e0-4534-b50f-ee364cd53f3e]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:26:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-44e3fa61-94a6-4c07-b713-c28e56804cc4 tempest-TestShelveInstance-1682337060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:22 devstack sudo[111923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 Jun 30 16:26:22 devstack sudo[111923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:23 devstack sudo[111923]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-44e3fa61-94a6-4c07-b713-c28e56804cc4 tempest-TestShelveInstance-1682337060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5" returned: 0 in 0.952s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-44e3fa61-94a6-4c07-b713-c28e56804cc4 tempest-TestShelveInstance-1682337060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:23 devstack sudo[111927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 Jun 30 16:26:23 devstack sudo[111927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:23 devstack sudo[111927]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-44e3fa61-94a6-4c07-b713-c28e56804cc4 tempest-TestShelveInstance-1682337060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5" returned: 1 in 0.933s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-44e3fa61-94a6-4c07-b713-c28e56804cc4 tempest-TestShelveInstance-1682337060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:26:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-44e3fa61-94a6-4c07-b713-c28e56804cc4 tempest-TestShelveInstance-1682337060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:23 devstack sudo[111933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5 Jun 30 16:26:23 devstack sudo[111933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:24 devstack sudo[111933]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-44e3fa61-94a6-4c07-b713-c28e56804cc4 tempest-TestShelveInstance-1682337060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-765f8ff9-bc7c-42a0-9566-2df1f62b73d5" returned: 0 in 0.905s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:24 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-44e3fa61-94a6-4c07-b713-c28e56804cc4 tempest-TestShelveInstance-1682337060 None] Lock "cinder-quobyte-765f8ff9-bc7c-42a0-9566-2df1f62b73d5" released by "delete_volume" :: held 2.882s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:26:24 devstack cinder-volume[93781]: DEBUG cinder.quota [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-44e3fa61-94a6-4c07-b713-c28e56804cc4 tempest-TestShelveInstance-1682337060 None] Created reservations ['5f44bce5-2da4-4bb9-9091-0f82234a3f75', '0ec173ef-0228-43bd-8603-a0ca06ee5587', '7d3feff8-dc1c-4503-a65e-69932156af81', '7764830a-8460-490e-b65f-11fc7300a64d'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:26:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-44e3fa61-94a6-4c07-b713-c28e56804cc4 tempest-TestShelveInstance-1682337060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:26:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-44e3fa61-94a6-4c07-b713-c28e56804cc4 tempest-TestShelveInstance-1682337060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:26:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-44e3fa61-94a6-4c07-b713-c28e56804cc4 tempest-TestShelveInstance-1682337060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:26:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-44e3fa61-94a6-4c07-b713-c28e56804cc4 tempest-TestShelveInstance-1682337060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:26:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-44e3fa61-94a6-4c07-b713-c28e56804cc4 tempest-TestShelveInstance-1682337060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:26:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-44e3fa61-94a6-4c07-b713-c28e56804cc4 tempest-TestShelveInstance-1682337060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:25 devstack sudo[111936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:26:25 devstack sudo[111936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2ee06d5a-64b7-41f9-a516-e970d7f8f5d7 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Acquiring lock "cinder-7ee2df36-6a4a-42bc-8e16-198a96281b5d-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:26:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2ee06d5a-64b7-41f9-a516-e970d7f8f5d7 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "cinder-7ee2df36-6a4a-42bc-8e16-198a96281b5d-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:26:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2ee06d5a-64b7-41f9-a516-e970d7f8f5d7 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Acquiring lock "cinder-quobyte-7ee2df36-6a4a-42bc-8e16-198a96281b5d" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:26:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2ee06d5a-64b7-41f9-a516-e970d7f8f5d7 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "cinder-quobyte-7ee2df36-6a4a-42bc-8e16-198a96281b5d" acquired by "delete_volume" :: waited 0.026s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:26:25 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54f553a-a2ca-4090-be5e-0adf6de4ce14]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:26:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2ee06d5a-64b7-41f9-a516-e970d7f8f5d7 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7ee2df36-6a4a-42bc-8e16-198a96281b5d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:25 devstack sudo[111938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7ee2df36-6a4a-42bc-8e16-198a96281b5d Jun 30 16:26:25 devstack sudo[111938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:25 devstack sudo[111936]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-44e3fa61-94a6-4c07-b713-c28e56804cc4 tempest-TestShelveInstance-1682337060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.902s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:25 devstack cinder-volume[93781]: DEBUG cinder.manager [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-44e3fa61-94a6-4c07-b713-c28e56804cc4 tempest-TestShelveInstance-1682337060 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:26:25 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-44e3fa61-94a6-4c07-b713-c28e56804cc4 tempest-TestShelveInstance-1682337060 None] Deleted volume successfully. Jun 30 16:26:26 devstack cinder-volume[93781]: DEBUG cinder.coordination [req-cb911ef2-ac67-42e8-82e6-6e939a449cf5 req-44e3fa61-94a6-4c07-b713-c28e56804cc4 tempest-TestShelveInstance-1682337060 None] Lock "cinder-765f8ff9-bc7c-42a0-9566-2df1f62b73d5-delete_volume" released by "delete_volume" :: held 4.114s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:26:26 devstack sudo[111938]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2ee06d5a-64b7-41f9-a516-e970d7f8f5d7 tempest-TestServerVolumeAttachmentScenario-2072671812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7ee2df36-6a4a-42bc-8e16-198a96281b5d" returned: 0 in 1.091s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2ee06d5a-64b7-41f9-a516-e970d7f8f5d7 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7ee2df36-6a4a-42bc-8e16-198a96281b5d {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:26 devstack sudo[111944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7ee2df36-6a4a-42bc-8e16-198a96281b5d Jun 30 16:26:26 devstack sudo[111944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:27 devstack sudo[111944]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2ee06d5a-64b7-41f9-a516-e970d7f8f5d7 tempest-TestServerVolumeAttachmentScenario-2072671812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-7ee2df36-6a4a-42bc-8e16-198a96281b5d" returned: 0 in 0.910s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:27 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2ee06d5a-64b7-41f9-a516-e970d7f8f5d7 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "cinder-quobyte-7ee2df36-6a4a-42bc-8e16-198a96281b5d" released by "delete_volume" :: held 2.070s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:26:27 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-2ee06d5a-64b7-41f9-a516-e970d7f8f5d7 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Created reservations ['f2fc94f3-12dd-4fec-929c-bc17fa10cc6c', 'a6e3f31f-257c-4af7-b5a4-7c91695d5c4d', 'f6dac4c2-27e5-4d6c-9a21-549cad2a20d6', '760dec99-ddde-49b2-b97a-82ad6d81d070'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:26:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2ee06d5a-64b7-41f9-a516-e970d7f8f5d7 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:26:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2ee06d5a-64b7-41f9-a516-e970d7f8f5d7 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:26:27 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-2ee06d5a-64b7-41f9-a516-e970d7f8f5d7 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:26:27 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-2ee06d5a-64b7-41f9-a516-e970d7f8f5d7 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:26:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2ee06d5a-64b7-41f9-a516-e970d7f8f5d7 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:26:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2ee06d5a-64b7-41f9-a516-e970d7f8f5d7 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:27 devstack sudo[111949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:26:27 devstack sudo[111949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:28 devstack sudo[111949]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2ee06d5a-64b7-41f9-a516-e970d7f8f5d7 tempest-TestServerVolumeAttachmentScenario-2072671812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.790s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:28 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-2ee06d5a-64b7-41f9-a516-e970d7f8f5d7 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:26:28 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-2ee06d5a-64b7-41f9-a516-e970d7f8f5d7 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Deleted volume successfully. Jun 30 16:26:28 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2ee06d5a-64b7-41f9-a516-e970d7f8f5d7 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "cinder-7ee2df36-6a4a-42bc-8e16-198a96281b5d-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:26:28 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6ad3e349-1d16-468f-84e3-8646a24b8a49 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Acquiring lock "cinder-9013402f-bb5b-4fee-9272-f35a27df9591-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:26:28 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6ad3e349-1d16-468f-84e3-8646a24b8a49 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "cinder-9013402f-bb5b-4fee-9272-f35a27df9591-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:26:28 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6ad3e349-1d16-468f-84e3-8646a24b8a49 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Acquiring lock "cinder-quobyte-9013402f-bb5b-4fee-9272-f35a27df9591" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:26:28 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6ad3e349-1d16-468f-84e3-8646a24b8a49 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "cinder-quobyte-9013402f-bb5b-4fee-9272-f35a27df9591" acquired by "delete_volume" :: waited 0.021s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:26:28 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[141e6295-f67a-4ec9-857b-b6eb8e632369]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:26:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6ad3e349-1d16-468f-84e3-8646a24b8a49 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9013402f-bb5b-4fee-9272-f35a27df9591 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:29 devstack sudo[111953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9013402f-bb5b-4fee-9272-f35a27df9591 Jun 30 16:26:29 devstack sudo[111953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:29 devstack sudo[111953]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6ad3e349-1d16-468f-84e3-8646a24b8a49 tempest-TestServerVolumeAttachmentScenario-2072671812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9013402f-bb5b-4fee-9272-f35a27df9591" returned: 0 in 1.062s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6ad3e349-1d16-468f-84e3-8646a24b8a49 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9013402f-bb5b-4fee-9272-f35a27df9591 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:29 devstack sudo[111958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9013402f-bb5b-4fee-9272-f35a27df9591 Jun 30 16:26:29 devstack sudo[111958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:30 devstack sudo[111958]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6ad3e349-1d16-468f-84e3-8646a24b8a49 tempest-TestServerVolumeAttachmentScenario-2072671812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9013402f-bb5b-4fee-9272-f35a27df9591" returned: 0 in 0.879s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:30 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6ad3e349-1d16-468f-84e3-8646a24b8a49 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "cinder-quobyte-9013402f-bb5b-4fee-9272-f35a27df9591" released by "delete_volume" :: held 1.998s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:26:30 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-6ad3e349-1d16-468f-84e3-8646a24b8a49 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Created reservations ['2ed8bcc7-7214-46b4-8124-e98ad6c946f2', 'c496f2e9-0a07-43d0-a561-9a3df136caf8', 'e732bf41-2b35-4d7e-a1aa-0db97a9ba9b1', 'a813cb2e-6a2f-4880-a657-f6ba49c3a10a'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:26:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6ad3e349-1d16-468f-84e3-8646a24b8a49 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:26:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6ad3e349-1d16-468f-84e3-8646a24b8a49 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:26:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6ad3e349-1d16-468f-84e3-8646a24b8a49 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:26:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6ad3e349-1d16-468f-84e3-8646a24b8a49 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:26:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6ad3e349-1d16-468f-84e3-8646a24b8a49 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:26:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6ad3e349-1d16-468f-84e3-8646a24b8a49 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:31 devstack sudo[111962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:26:31 devstack sudo[111962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:31 devstack sudo[111962]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6ad3e349-1d16-468f-84e3-8646a24b8a49 tempest-TestServerVolumeAttachmentScenario-2072671812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.792s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:31 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-6ad3e349-1d16-468f-84e3-8646a24b8a49 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:26:31 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-6ad3e349-1d16-468f-84e3-8646a24b8a49 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Deleted volume successfully. Jun 30 16:26:31 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6ad3e349-1d16-468f-84e3-8646a24b8a49 tempest-TestServerVolumeAttachmentScenario-2072671812 None] Lock "cinder-9013402f-bb5b-4fee-9272-f35a27df9591-delete_volume" released by "delete_volume" :: held 3.142s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:26:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:26:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:26:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:26:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:26:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:26:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:26:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:33 devstack sudo[111967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:26:33 devstack sudo[111967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:33 devstack sudo[111967]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.866s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:33 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:26:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:26:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 28 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:26:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:26:40 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:26:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Flow 'volume_create_manager' (fe1ddf8c-48eb-4231-abad-3b6a140729b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:26:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e5d15e-113d-413d-b5b6-5385247aa5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e5d15e-113d-413d-b5b6-5385247aa5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1694696054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e475f950-45ab-4cac-8e87-7fa5fbd1a0e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756786d031a140a3a950985c6fd88c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:26:41Z,use_quota=True,user_id='4590465e48b14ff7874f226b5cc4c5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31eeb6a1-ac5a-431a-a1d6-183bfc2e377c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31eeb6a1-ac5a-431a-a1d6-183bfc2e377c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f63d38-279b-470f-89e8-13443ec02210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f63d38-279b-470f-89e8-13443ec02210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e475f950-45ab-4cac-8e87-7fa5fbd1a0e1', 'volume_name': 'volume-e475f950-45ab-4cac-8e87-7fa5fbd1a0e1', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54536c4c-6d57-44b7-8197-620222173704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54536c4c-6d57-44b7-8197-620222173704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:40 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71fbe075-72b1-4665-bbb1-b8f0a7db77b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:40 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Volume e475f950-45ab-4cac-8e87-7fa5fbd1a0e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e475f950-45ab-4cac-8e87-7fa5fbd1a0e1', 'volume_size': 1} Jun 30 16:26:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:26:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:26:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1694696054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e475f950-45ab-4cac-8e87-7fa5fbd1a0e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756786d031a140a3a950985c6fd88c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:26:41Z,use_quota=True,user_id='4590465e48b14ff7874f226b5cc4c5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:26:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Creating volume e475f950-45ab-4cac-8e87-7fa5fbd1a0e1 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:26:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:26:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:26:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:26:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:26:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:26:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:26:40 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:26:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e475f950-45ab-4cac-8e87-7fa5fbd1a0e1 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:40 devstack sudo[111974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e475f950-45ab-4cac-8e87-7fa5fbd1a0e1 1073741824 Jun 30 16:26:40 devstack sudo[111974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:42 devstack sudo[111974]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e475f950-45ab-4cac-8e87-7fa5fbd1a0e1 1073741824" returned: 0 in 1.139s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e475f950-45ab-4cac-8e87-7fa5fbd1a0e1 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:42 devstack sudo[111980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e475f950-45ab-4cac-8e87-7fa5fbd1a0e1 Jun 30 16:26:42 devstack sudo[111980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:42 devstack sudo[111980]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e475f950-45ab-4cac-8e87-7fa5fbd1a0e1" returned: 0 in 0.777s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:42 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:26:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:26:42 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71fbe075-72b1-4665-bbb1-b8f0a7db77b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e475f950-45ab-4cac-8e87-7fa5fbd1a0e1', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:42 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f8c4e0b-88df-4d1f-8c45-d7247267cb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:42 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Volume volume-e475f950-45ab-4cac-8e87-7fa5fbd1a0e1 (e475f950-45ab-4cac-8e87-7fa5fbd1a0e1): created successfully Jun 30 16:26:42 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f8c4e0b-88df-4d1f-8c45-d7247267cb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:42 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Flow 'volume_create_manager' (fe1ddf8c-48eb-4231-abad-3b6a140729b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:26:42 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-3d8940bc-2181-4702-94f4-50e7f2f71dcb tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Created volume successfully. Jun 30 16:26:44 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:26:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Flow 'volume_create_manager' (b0534855-5234-4f88-84c9-7c3912c52708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:26:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e977fc0e-61f4-4b72-bc05-ce3693f32cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e977fc0e-61f4-4b72-bc05-ce3693f32cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1497674954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d417ad-7c00-4564-b70c-8e83ee166ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756786d031a140a3a950985c6fd88c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:26:45Z,use_quota=True,user_id='4590465e48b14ff7874f226b5cc4c5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a717e4-4030-4b6c-a02a-fcf3d7f8fe11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a717e4-4030-4b6c-a02a-fcf3d7f8fe11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331586eb-40ce-4937-9372-30fdc5bb2df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331586eb-40ce-4937-9372-30fdc5bb2df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6d417ad-7c00-4564-b70c-8e83ee166ddb', 'volume_name': 'volume-f6d417ad-7c00-4564-b70c-8e83ee166ddb', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045cd3ca-e828-450a-ba9b-9a2d745b4be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045cd3ca-e828-450a-ba9b-9a2d745b4be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cdfecb8-3428-4953-a29f-b6432551d4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:44 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Volume f6d417ad-7c00-4564-b70c-8e83ee166ddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6d417ad-7c00-4564-b70c-8e83ee166ddb', 'volume_size': 1} Jun 30 16:26:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:26:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:26:44 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1497674954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d417ad-7c00-4564-b70c-8e83ee166ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756786d031a140a3a950985c6fd88c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:26:45Z,use_quota=True,user_id='4590465e48b14ff7874f226b5cc4c5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:26:44 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Creating volume f6d417ad-7c00-4564-b70c-8e83ee166ddb {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:26:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:26:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:26:44 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:26:44 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:26:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:26:44 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:26:44 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:26:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6d417ad-7c00-4564-b70c-8e83ee166ddb 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:44 devstack sudo[111990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6d417ad-7c00-4564-b70c-8e83ee166ddb 1073741824 Jun 30 16:26:44 devstack sudo[111990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:45 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:26:45 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Flow 'volume_create_manager' (7bce43a7-53b4-4097-a8a3-e8123e29699c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:26:45 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1409f88-b69a-4713-8000-8e4f456039b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:45 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1409f88-b69a-4713-8000-8e4f456039b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-698366860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c78ba8-721d-4798-b128-7ebc2c507021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756786d031a140a3a950985c6fd88c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:26:45Z,use_quota=True,user_id='4590465e48b14ff7874f226b5cc4c5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:45 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca884ee3-bd61-4867-9975-1d90aea516f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:45 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca884ee3-bd61-4867-9975-1d90aea516f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:45 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519e6b03-2abc-4e6e-9f08-2de0a5a3dffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:45 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (519e6b03-2abc-4e6e-9f08-2de0a5a3dffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6c78ba8-721d-4798-b128-7ebc2c507021', 'volume_name': 'volume-b6c78ba8-721d-4798-b128-7ebc2c507021', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:45 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70efa5d9-73d0-4a61-818c-38fca202617d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:45 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70efa5d9-73d0-4a61-818c-38fca202617d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:45 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9db6341-95b0-4a7d-b5cc-2ac31855e3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:45 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Volume b6c78ba8-721d-4798-b128-7ebc2c507021: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6c78ba8-721d-4798-b128-7ebc2c507021', 'volume_size': 1} Jun 30 16:26:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:26:45 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:26:45 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Flow 'volume_create_manager' (6e492d3e-95f9-4839-8877-7352af00f786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e5a11c-d1a9-4a3f-91ec-a061543d4747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e5a11c-d1a9-4a3f-91ec-a061543d4747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1212471404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5abd000a-a31e-4fda-9ac8-54edf480698b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756786d031a140a3a950985c6fd88c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:26:46Z,use_quota=True,user_id='4590465e48b14ff7874f226b5cc4c5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e43d16-1494-4edc-9837-10a2147ac03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e43d16-1494-4edc-9837-10a2147ac03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296d2d4c-4c57-4d9c-bc7b-46094f987623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296d2d4c-4c57-4d9c-bc7b-46094f987623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5abd000a-a31e-4fda-9ac8-54edf480698b', 'volume_name': 'volume-5abd000a-a31e-4fda-9ac8-54edf480698b', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e02d8d7c-97c4-4cb4-9d48-a8daacb4c4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e02d8d7c-97c4-4cb4-9d48-a8daacb4c4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744569f5-7062-44ba-90f3-32b8e7f1c3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:46 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Volume 5abd000a-a31e-4fda-9ac8-54edf480698b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5abd000a-a31e-4fda-9ac8-54edf480698b', 'volume_size': 1} Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:26:46 devstack sudo[111990]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6d417ad-7c00-4564-b70c-8e83ee166ddb 1073741824" returned: 0 in 1.367s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6d417ad-7c00-4564-b70c-8e83ee166ddb {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:46 devstack sudo[111996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6d417ad-7c00-4564-b70c-8e83ee166ddb Jun 30 16:26:46 devstack sudo[111996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Flow 'volume_create_manager' (040cbb81-4405-4192-ad94-b9c0c4d6ade9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528de91e-9ce7-4018-bda0-4ff4c4124391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528de91e-9ce7-4018-bda0-4ff4c4124391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-416563050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1787a3f2-dc6f-4bce-8ee3-bd27674e2619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756786d031a140a3a950985c6fd88c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:26:46Z,use_quota=True,user_id='4590465e48b14ff7874f226b5cc4c5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b10cd3-1fa7-4540-bfde-f6f8c1704715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b10cd3-1fa7-4540-bfde-f6f8c1704715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (548405f6-10bf-4d0e-8aa6-30627cd3aa1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (548405f6-10bf-4d0e-8aa6-30627cd3aa1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1787a3f2-dc6f-4bce-8ee3-bd27674e2619', 'volume_name': 'volume-1787a3f2-dc6f-4bce-8ee3-bd27674e2619', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4997971-2d07-4254-a94a-9dace334361e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4997971-2d07-4254-a94a-9dace334361e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a752d40-74f7-4d97-bb0d-c49a6d7b2df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:46 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Volume 1787a3f2-dc6f-4bce-8ee3-bd27674e2619: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1787a3f2-dc6f-4bce-8ee3-bd27674e2619', 'volume_size': 1} Jun 30 16:26:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Flow 'volume_create_manager' (4b184659-4736-4ede-bf3d-273af711506c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36aec471-ff7b-42c8-8c02-8c1f34f374f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36aec471-ff7b-42c8-8c02-8c1f34f374f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1716793747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3188603f-0df3-4d2e-9c9a-98459249dcff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756786d031a140a3a950985c6fd88c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:26:47Z,use_quota=True,user_id='4590465e48b14ff7874f226b5cc4c5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea42963-207b-4116-8b3a-04b1824b2489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea42963-207b-4116-8b3a-04b1824b2489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:47 devstack sudo[111996]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (551114f1-6b3d-4506-9415-75fef9efcab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (551114f1-6b3d-4506-9415-75fef9efcab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3188603f-0df3-4d2e-9c9a-98459249dcff', 'volume_name': 'volume-3188603f-0df3-4d2e-9c9a-98459249dcff', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b03c279-4d00-4b91-8733-780dbea252fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b03c279-4d00-4b91-8733-780dbea252fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f41a5c-601f-4d6d-95d7-dd6417183e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:47 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Volume 3188603f-0df3-4d2e-9c9a-98459249dcff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3188603f-0df3-4d2e-9c9a-98459249dcff', 'volume_size': 1} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6d417ad-7c00-4564-b70c-8e83ee166ddb" returned: 0 in 0.845s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] <== create_volume: return (2277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.281s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.519s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-698366860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c78ba8-721d-4798-b128-7ebc2c507021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756786d031a140a3a950985c6fd88c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:26:45Z,use_quota=True,user_id='4590465e48b14ff7874f226b5cc4c5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Creating volume b6c78ba8-721d-4798-b128-7ebc2c507021 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:26:47 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6c78ba8-721d-4798-b128-7ebc2c507021 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:47 devstack sudo[112000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6c78ba8-721d-4798-b128-7ebc2c507021 1073741824 Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cdfecb8-3428-4953-a29f-b6432551d4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6d417ad-7c00-4564-b70c-8e83ee166ddb', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:47 devstack sudo[112000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a55052-db19-438a-80cb-f2d599c7b69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:47 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Volume volume-f6d417ad-7c00-4564-b70c-8e83ee166ddb (f6d417ad-7c00-4564-b70c-8e83ee166ddb): created successfully Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a55052-db19-438a-80cb-f2d599c7b69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Flow 'volume_create_manager' (b0534855-5234-4f88-84c9-7c3912c52708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:26:47 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-204af98f-605b-4773-8dc1-352e70e70f9d tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Created volume successfully. Jun 30 16:26:48 devstack sudo[112000]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6c78ba8-721d-4798-b128-7ebc2c507021 1073741824" returned: 0 in 1.031s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6c78ba8-721d-4798-b128-7ebc2c507021 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:48 devstack sudo[112006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6c78ba8-721d-4798-b128-7ebc2c507021 Jun 30 16:26:48 devstack sudo[112006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:49 devstack sudo[112006]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6c78ba8-721d-4798-b128-7ebc2c507021" returned: 0 in 0.913s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:26:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:26:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.122s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:26:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1212471404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5abd000a-a31e-4fda-9ac8-54edf480698b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756786d031a140a3a950985c6fd88c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:26:46Z,use_quota=True,user_id='4590465e48b14ff7874f226b5cc4c5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:26:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Creating volume 5abd000a-a31e-4fda-9ac8-54edf480698b {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:26:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:26:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:26:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:26:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:26:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:26:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:26:49 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:26:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5abd000a-a31e-4fda-9ac8-54edf480698b 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9db6341-95b0-4a7d-b5cc-2ac31855e3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6c78ba8-721d-4798-b128-7ebc2c507021', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:49 devstack sudo[112009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5abd000a-a31e-4fda-9ac8-54edf480698b 1073741824 Jun 30 16:26:49 devstack sudo[112009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f03894-76c6-44d1-bee9-1c66563c93d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:49 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Volume volume-b6c78ba8-721d-4798-b128-7ebc2c507021 (b6c78ba8-721d-4798-b128-7ebc2c507021): created successfully Jun 30 16:26:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f03894-76c6-44d1-bee9-1c66563c93d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Flow 'volume_create_manager' (7bce43a7-53b4-4097-a8a3-e8123e29699c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:26:49 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-a029e98b-c240-42df-b558-7f3558191e90 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Created volume successfully. Jun 30 16:26:50 devstack sudo[112009]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5abd000a-a31e-4fda-9ac8-54edf480698b 1073741824" returned: 0 in 1.159s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5abd000a-a31e-4fda-9ac8-54edf480698b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:50 devstack sudo[112015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5abd000a-a31e-4fda-9ac8-54edf480698b Jun 30 16:26:50 devstack sudo[112015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:51 devstack sudo[112015]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5abd000a-a31e-4fda-9ac8-54edf480698b" returned: 0 in 0.908s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:51 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] <== create_volume: return (2133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:26:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.139s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:26:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.757s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:26:51 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-416563050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1787a3f2-dc6f-4bce-8ee3-bd27674e2619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756786d031a140a3a950985c6fd88c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:26:46Z,use_quota=True,user_id='4590465e48b14ff7874f226b5cc4c5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:26:51 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Creating volume 1787a3f2-dc6f-4bce-8ee3-bd27674e2619 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:26:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:26:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:26:51 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:26:51 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:26:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:26:51 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:26:51 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:26:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-1787a3f2-dc6f-4bce-8ee3-bd27674e2619 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:51 devstack sudo[112020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-1787a3f2-dc6f-4bce-8ee3-bd27674e2619 1073741824 Jun 30 16:26:51 devstack sudo[112020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744569f5-7062-44ba-90f3-32b8e7f1c3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5abd000a-a31e-4fda-9ac8-54edf480698b', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daaf7821-4706-4850-bf53-c139cd6fabe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:51 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Volume volume-5abd000a-a31e-4fda-9ac8-54edf480698b (5abd000a-a31e-4fda-9ac8-54edf480698b): created successfully Jun 30 16:26:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daaf7821-4706-4850-bf53-c139cd6fabe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Flow 'volume_create_manager' (6e492d3e-95f9-4839-8877-7352af00f786) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:26:51 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-f647f016-32f5-490d-baa2-5a832340c9fe tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Created volume successfully. Jun 30 16:26:52 devstack sudo[112020]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-1787a3f2-dc6f-4bce-8ee3-bd27674e2619 1073741824" returned: 0 in 1.167s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-1787a3f2-dc6f-4bce-8ee3-bd27674e2619 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:52 devstack sudo[112026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-1787a3f2-dc6f-4bce-8ee3-bd27674e2619 Jun 30 16:26:52 devstack sudo[112026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:53 devstack sudo[112026]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-1787a3f2-dc6f-4bce-8ee3-bd27674e2619" returned: 0 in 0.748s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:26:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:26:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.159s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:26:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1716793747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3188603f-0df3-4d2e-9c9a-98459249dcff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756786d031a140a3a950985c6fd88c21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:26:47Z,use_quota=True,user_id='4590465e48b14ff7874f226b5cc4c5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:26:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Creating volume 3188603f-0df3-4d2e-9c9a-98459249dcff {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:26:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:26:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:26:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:26:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:26:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:26:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:26:53 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:26:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3188603f-0df3-4d2e-9c9a-98459249dcff 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a752d40-74f7-4d97-bb0d-c49a6d7b2df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1787a3f2-dc6f-4bce-8ee3-bd27674e2619', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c56b257-34b8-49f6-8f49-a0ecc7372368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:53 devstack sudo[112032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3188603f-0df3-4d2e-9c9a-98459249dcff 1073741824 Jun 30 16:26:53 devstack sudo[112032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:53 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Volume volume-1787a3f2-dc6f-4bce-8ee3-bd27674e2619 (1787a3f2-dc6f-4bce-8ee3-bd27674e2619): created successfully Jun 30 16:26:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c56b257-34b8-49f6-8f49-a0ecc7372368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Flow 'volume_create_manager' (040cbb81-4405-4192-ad94-b9c0c4d6ade9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:26:53 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-ed0b1c05-a4bf-44cc-9e72-be0de44fdcd5 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Created volume successfully. Jun 30 16:26:54 devstack sudo[112032]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3188603f-0df3-4d2e-9c9a-98459249dcff 1073741824" returned: 0 in 1.341s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3188603f-0df3-4d2e-9c9a-98459249dcff {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:54 devstack sudo[112038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3188603f-0df3-4d2e-9c9a-98459249dcff Jun 30 16:26:54 devstack sudo[112038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:55 devstack sudo[112038]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3188603f-0df3-4d2e-9c9a-98459249dcff" returned: 0 in 0.765s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:55 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] <== create_volume: return (2168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:26:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.174s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:26:55 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f41a5c-601f-4d6d-95d7-dd6417183e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3188603f-0df3-4d2e-9c9a-98459249dcff', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:55 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d09bcf2-fb62-4fc7-a103-bb6b0a59cdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:26:55 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Volume volume-3188603f-0df3-4d2e-9c9a-98459249dcff (3188603f-0df3-4d2e-9c9a-98459249dcff): created successfully Jun 30 16:26:55 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d09bcf2-fb62-4fc7-a103-bb6b0a59cdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:26:55 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Flow 'volume_create_manager' (4b184659-4736-4ede-bf3d-273af711506c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:26:55 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-dee6edd4-13ab-437f-a678-4577ab852434 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Created volume successfully. Jun 30 16:26:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-0767a337-f30a-4590-a852-ffe9bcb3ee60 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "cinder-3188603f-0df3-4d2e-9c9a-98459249dcff-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:26:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-0767a337-f30a-4590-a852-ffe9bcb3ee60 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-3188603f-0df3-4d2e-9c9a-98459249dcff-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:26:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-0767a337-f30a-4590-a852-ffe9bcb3ee60 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "cinder-quobyte-3188603f-0df3-4d2e-9c9a-98459249dcff" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:26:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-0767a337-f30a-4590-a852-ffe9bcb3ee60 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-quobyte-3188603f-0df3-4d2e-9c9a-98459249dcff" acquired by "delete_volume" :: waited 0.021s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:26:56 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93afb0a-cc12-464e-879a-0c1756bb605b]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:26:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0767a337-f30a-4590-a852-ffe9bcb3ee60 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3188603f-0df3-4d2e-9c9a-98459249dcff {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:56 devstack sudo[112041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3188603f-0df3-4d2e-9c9a-98459249dcff Jun 30 16:26:56 devstack sudo[112041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:57 devstack sudo[112041]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0767a337-f30a-4590-a852-ffe9bcb3ee60 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3188603f-0df3-4d2e-9c9a-98459249dcff" returned: 0 in 1.063s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0767a337-f30a-4590-a852-ffe9bcb3ee60 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3188603f-0df3-4d2e-9c9a-98459249dcff {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:57 devstack sudo[112048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3188603f-0df3-4d2e-9c9a-98459249dcff Jun 30 16:26:57 devstack sudo[112048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:58 devstack sudo[112048]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0767a337-f30a-4590-a852-ffe9bcb3ee60 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3188603f-0df3-4d2e-9c9a-98459249dcff" returned: 0 in 0.860s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:58 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-0767a337-f30a-4590-a852-ffe9bcb3ee60 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-quobyte-3188603f-0df3-4d2e-9c9a-98459249dcff" released by "delete_volume" :: held 1.985s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:26:58 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-0767a337-f30a-4590-a852-ffe9bcb3ee60 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Created reservations ['be571fc3-ccb1-40ef-a3f1-bfca36f85824', '9dca4c18-9e4f-4fd4-8e20-a34213da6cba', '9275c900-1b39-40c1-9314-9345fdd2ee68', 'c03c15db-2277-45cb-a0f8-a1b3c54c727c'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:26:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0767a337-f30a-4590-a852-ffe9bcb3ee60 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:26:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0767a337-f30a-4590-a852-ffe9bcb3ee60 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:26:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-0767a337-f30a-4590-a852-ffe9bcb3ee60 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:26:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-0767a337-f30a-4590-a852-ffe9bcb3ee60 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:26:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0767a337-f30a-4590-a852-ffe9bcb3ee60 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:26:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0767a337-f30a-4590-a852-ffe9bcb3ee60 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:58 devstack sudo[112051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:26:58 devstack sudo[112051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:26:59 devstack sudo[112051]: pam_unix(sudo:session): session closed for user root Jun 30 16:26:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0767a337-f30a-4590-a852-ffe9bcb3ee60 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.857s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:26:59 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-0767a337-f30a-4590-a852-ffe9bcb3ee60 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:26:59 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-0767a337-f30a-4590-a852-ffe9bcb3ee60 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Deleted volume successfully. Jun 30 16:26:59 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-0767a337-f30a-4590-a852-ffe9bcb3ee60 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-3188603f-0df3-4d2e-9c9a-98459249dcff-delete_volume" released by "delete_volume" :: held 3.177s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:26:59 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e559e80d-af29-4469-9366-9b4d156cb87f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "cinder-1787a3f2-dc6f-4bce-8ee3-bd27674e2619-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:26:59 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e559e80d-af29-4469-9366-9b4d156cb87f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-1787a3f2-dc6f-4bce-8ee3-bd27674e2619-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:26:59 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e559e80d-af29-4469-9366-9b4d156cb87f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "cinder-quobyte-1787a3f2-dc6f-4bce-8ee3-bd27674e2619" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:26:59 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e559e80d-af29-4469-9366-9b4d156cb87f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-quobyte-1787a3f2-dc6f-4bce-8ee3-bd27674e2619" acquired by "delete_volume" :: waited 0.026s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:26:59 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[7776994c-448b-4e5e-9563-874cb201ac46]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:26:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e559e80d-af29-4469-9366-9b4d156cb87f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-1787a3f2-dc6f-4bce-8ee3-bd27674e2619 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:26:59 devstack sudo[112054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-1787a3f2-dc6f-4bce-8ee3-bd27674e2619 Jun 30 16:26:59 devstack sudo[112054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:00 devstack sudo[112054]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e559e80d-af29-4469-9366-9b4d156cb87f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-1787a3f2-dc6f-4bce-8ee3-bd27674e2619" returned: 0 in 0.905s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e559e80d-af29-4469-9366-9b4d156cb87f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-1787a3f2-dc6f-4bce-8ee3-bd27674e2619 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:00 devstack sudo[112060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-1787a3f2-dc6f-4bce-8ee3-bd27674e2619 Jun 30 16:27:00 devstack sudo[112060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:01 devstack sudo[112060]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e559e80d-af29-4469-9366-9b4d156cb87f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-1787a3f2-dc6f-4bce-8ee3-bd27674e2619" returned: 0 in 0.783s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e559e80d-af29-4469-9366-9b4d156cb87f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-quobyte-1787a3f2-dc6f-4bce-8ee3-bd27674e2619" released by "delete_volume" :: held 1.760s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:27:01 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-e559e80d-af29-4469-9366-9b4d156cb87f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Created reservations ['41c1e331-6497-4ed8-82d2-e14eff30e05f', '2db8aa48-6fc3-45fa-8dbc-e2cb426503bf', '92ebe8a8-2a59-43fc-83e0-3cc6711f3fb6', 'fcafaf91-430b-4f10-90d1-4f675e7808dc'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:27:01 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=53,cinder:UPDATE=58,cinder:INSERT=16,cinder:DELETE=5 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:27:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e559e80d-af29-4469-9366-9b4d156cb87f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:27:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e559e80d-af29-4469-9366-9b4d156cb87f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:27:01 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e559e80d-af29-4469-9366-9b4d156cb87f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:27:01 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e559e80d-af29-4469-9366-9b4d156cb87f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:27:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e559e80d-af29-4469-9366-9b4d156cb87f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:27:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e559e80d-af29-4469-9366-9b4d156cb87f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:01 devstack sudo[112063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:27:01 devstack sudo[112063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f82894c9-6026-4c4b-af9b-2a5acef09df0 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "cinder-5abd000a-a31e-4fda-9ac8-54edf480698b-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:27:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f82894c9-6026-4c4b-af9b-2a5acef09df0 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-5abd000a-a31e-4fda-9ac8-54edf480698b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:27:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f82894c9-6026-4c4b-af9b-2a5acef09df0 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "cinder-quobyte-5abd000a-a31e-4fda-9ac8-54edf480698b" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:27:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f82894c9-6026-4c4b-af9b-2a5acef09df0 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-quobyte-5abd000a-a31e-4fda-9ac8-54edf480698b" acquired by "delete_volume" :: waited 0.020s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:27:01 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[8581b869-aa0b-4ed8-afcc-efc5a0fc827f]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:27:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f82894c9-6026-4c4b-af9b-2a5acef09df0 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5abd000a-a31e-4fda-9ac8-54edf480698b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:02 devstack sudo[112065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5abd000a-a31e-4fda-9ac8-54edf480698b Jun 30 16:27:02 devstack sudo[112065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:02 devstack sudo[112063]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e559e80d-af29-4469-9366-9b4d156cb87f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.915s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:02 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-e559e80d-af29-4469-9366-9b4d156cb87f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:27:02 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-e559e80d-af29-4469-9366-9b4d156cb87f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Deleted volume successfully. Jun 30 16:27:02 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e559e80d-af29-4469-9366-9b4d156cb87f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-1787a3f2-dc6f-4bce-8ee3-bd27674e2619-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:27:03 devstack sudo[112065]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f82894c9-6026-4c4b-af9b-2a5acef09df0 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5abd000a-a31e-4fda-9ac8-54edf480698b" returned: 0 in 1.040s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f82894c9-6026-4c4b-af9b-2a5acef09df0 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5abd000a-a31e-4fda-9ac8-54edf480698b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:03 devstack sudo[112071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5abd000a-a31e-4fda-9ac8-54edf480698b Jun 30 16:27:03 devstack sudo[112071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:03 devstack sudo[112071]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f82894c9-6026-4c4b-af9b-2a5acef09df0 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5abd000a-a31e-4fda-9ac8-54edf480698b" returned: 0 in 0.797s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:03 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f82894c9-6026-4c4b-af9b-2a5acef09df0 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-quobyte-5abd000a-a31e-4fda-9ac8-54edf480698b" released by "delete_volume" :: held 1.902s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:27:03 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-f82894c9-6026-4c4b-af9b-2a5acef09df0 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Created reservations ['e0b9b936-200e-4961-98aa-a8bfc2d31dee', '28426245-ed2c-42e9-863a-c5ce38971378', '2d4ccc88-48a3-4242-abc5-a8ec62e1c21a', 'a8ade29d-52c4-41ce-8376-d9184ccdf723'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:27:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f82894c9-6026-4c4b-af9b-2a5acef09df0 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:27:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f82894c9-6026-4c4b-af9b-2a5acef09df0 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:27:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f82894c9-6026-4c4b-af9b-2a5acef09df0 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:27:04 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f82894c9-6026-4c4b-af9b-2a5acef09df0 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:27:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f82894c9-6026-4c4b-af9b-2a5acef09df0 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:27:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f82894c9-6026-4c4b-af9b-2a5acef09df0 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:04 devstack sudo[112074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:27:04 devstack sudo[112074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-88c4539e-7ac5-4428-a7b0-e02bc74353d6 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "cinder-b6c78ba8-721d-4798-b128-7ebc2c507021-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:27:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-88c4539e-7ac5-4428-a7b0-e02bc74353d6 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-b6c78ba8-721d-4798-b128-7ebc2c507021-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:27:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-88c4539e-7ac5-4428-a7b0-e02bc74353d6 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "cinder-quobyte-b6c78ba8-721d-4798-b128-7ebc2c507021" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:27:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-88c4539e-7ac5-4428-a7b0-e02bc74353d6 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-quobyte-b6c78ba8-721d-4798-b128-7ebc2c507021" acquired by "delete_volume" :: waited 0.026s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:27:04 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffda2b8-4ba6-4aed-bc6c-39c925267c3c]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:27:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88c4539e-7ac5-4428-a7b0-e02bc74353d6 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6c78ba8-721d-4798-b128-7ebc2c507021 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:04 devstack sudo[112076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6c78ba8-721d-4798-b128-7ebc2c507021 Jun 30 16:27:04 devstack sudo[112076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:04 devstack sudo[112074]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f82894c9-6026-4c4b-af9b-2a5acef09df0 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.813s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:04 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-f82894c9-6026-4c4b-af9b-2a5acef09df0 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:27:04 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-f82894c9-6026-4c4b-af9b-2a5acef09df0 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Deleted volume successfully. Jun 30 16:27:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f82894c9-6026-4c4b-af9b-2a5acef09df0 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-5abd000a-a31e-4fda-9ac8-54edf480698b-delete_volume" released by "delete_volume" :: held 3.076s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:27:05 devstack sudo[112076]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88c4539e-7ac5-4428-a7b0-e02bc74353d6 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6c78ba8-721d-4798-b128-7ebc2c507021" returned: 0 in 0.956s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88c4539e-7ac5-4428-a7b0-e02bc74353d6 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6c78ba8-721d-4798-b128-7ebc2c507021 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:05 devstack sudo[112083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6c78ba8-721d-4798-b128-7ebc2c507021 Jun 30 16:27:05 devstack sudo[112083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:05 devstack sudo[112083]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88c4539e-7ac5-4428-a7b0-e02bc74353d6 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6c78ba8-721d-4798-b128-7ebc2c507021" returned: 0 in 0.744s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-88c4539e-7ac5-4428-a7b0-e02bc74353d6 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-quobyte-b6c78ba8-721d-4798-b128-7ebc2c507021" released by "delete_volume" :: held 1.753s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:27:06 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-88c4539e-7ac5-4428-a7b0-e02bc74353d6 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Created reservations ['5bb04ca3-5248-487b-aaad-5c9ef41dac43', 'af5c4ea1-6b86-47dc-954b-fc7aa55f4a3e', 'fd58c89c-42b9-434e-bcfd-1298f57233aa', 'a5cca44d-d574-45c4-b6a8-36a802db182b'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:27:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-88c4539e-7ac5-4428-a7b0-e02bc74353d6 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:27:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-88c4539e-7ac5-4428-a7b0-e02bc74353d6 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:27:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-88c4539e-7ac5-4428-a7b0-e02bc74353d6 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:27:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-88c4539e-7ac5-4428-a7b0-e02bc74353d6 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:27:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-88c4539e-7ac5-4428-a7b0-e02bc74353d6 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:27:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88c4539e-7ac5-4428-a7b0-e02bc74353d6 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:06 devstack sudo[112086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:27:06 devstack sudo[112086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f82c745d-6eed-4e9c-b177-1fd7df8f2c0f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "cinder-f6d417ad-7c00-4564-b70c-8e83ee166ddb-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:27:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f82c745d-6eed-4e9c-b177-1fd7df8f2c0f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-f6d417ad-7c00-4564-b70c-8e83ee166ddb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:27:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f82c745d-6eed-4e9c-b177-1fd7df8f2c0f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "cinder-quobyte-f6d417ad-7c00-4564-b70c-8e83ee166ddb" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:27:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f82c745d-6eed-4e9c-b177-1fd7df8f2c0f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-quobyte-f6d417ad-7c00-4564-b70c-8e83ee166ddb" acquired by "delete_volume" :: waited 0.029s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:27:06 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d02170-85ea-4f4d-b6b3-ccf89a05d8b4]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:27:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f82c745d-6eed-4e9c-b177-1fd7df8f2c0f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6d417ad-7c00-4564-b70c-8e83ee166ddb {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:06 devstack sudo[112088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6d417ad-7c00-4564-b70c-8e83ee166ddb Jun 30 16:27:06 devstack sudo[112088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:07 devstack sudo[112086]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-88c4539e-7ac5-4428-a7b0-e02bc74353d6 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.089s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:07 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-88c4539e-7ac5-4428-a7b0-e02bc74353d6 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:27:07 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-88c4539e-7ac5-4428-a7b0-e02bc74353d6 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Deleted volume successfully. Jun 30 16:27:07 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-88c4539e-7ac5-4428-a7b0-e02bc74353d6 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-b6c78ba8-721d-4798-b128-7ebc2c507021-delete_volume" released by "delete_volume" :: held 3.144s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:27:07 devstack sudo[112088]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f82c745d-6eed-4e9c-b177-1fd7df8f2c0f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6d417ad-7c00-4564-b70c-8e83ee166ddb" returned: 0 in 0.966s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f82c745d-6eed-4e9c-b177-1fd7df8f2c0f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6d417ad-7c00-4564-b70c-8e83ee166ddb {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:07 devstack sudo[112097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6d417ad-7c00-4564-b70c-8e83ee166ddb Jun 30 16:27:07 devstack sudo[112097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:08 devstack sudo[112097]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f82c745d-6eed-4e9c-b177-1fd7df8f2c0f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f6d417ad-7c00-4564-b70c-8e83ee166ddb" returned: 0 in 0.771s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:08 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f82c745d-6eed-4e9c-b177-1fd7df8f2c0f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-quobyte-f6d417ad-7c00-4564-b70c-8e83ee166ddb" released by "delete_volume" :: held 1.822s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:27:08 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-f82c745d-6eed-4e9c-b177-1fd7df8f2c0f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Created reservations ['3947e6f9-7ccc-4d94-a6e0-8a4ed46ca7fc', '174ac8a9-7756-472f-b44f-6486b5039fae', 'd61da5a7-c989-4f11-93e3-f30c7fd75f84', '0ae5f4b2-65f1-4d24-9d5a-8810ae32d82c'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:27:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f82c745d-6eed-4e9c-b177-1fd7df8f2c0f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:27:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f82c745d-6eed-4e9c-b177-1fd7df8f2c0f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:27:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f82c745d-6eed-4e9c-b177-1fd7df8f2c0f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:27:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f82c745d-6eed-4e9c-b177-1fd7df8f2c0f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:27:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f82c745d-6eed-4e9c-b177-1fd7df8f2c0f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:27:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f82c745d-6eed-4e9c-b177-1fd7df8f2c0f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:08 devstack sudo[112100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:27:08 devstack sudo[112100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:08 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c4b52c21-69d9-47a7-9e06-76583aa0b010 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "cinder-e475f950-45ab-4cac-8e87-7fa5fbd1a0e1-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:27:08 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c4b52c21-69d9-47a7-9e06-76583aa0b010 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-e475f950-45ab-4cac-8e87-7fa5fbd1a0e1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:27:08 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c4b52c21-69d9-47a7-9e06-76583aa0b010 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "cinder-quobyte-e475f950-45ab-4cac-8e87-7fa5fbd1a0e1" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:27:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c4b52c21-69d9-47a7-9e06-76583aa0b010 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-quobyte-e475f950-45ab-4cac-8e87-7fa5fbd1a0e1" acquired by "delete_volume" :: waited 0.021s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:27:09 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[61eacd2c-576d-445e-8ccc-08a245c5eece]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:27:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c4b52c21-69d9-47a7-9e06-76583aa0b010 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e475f950-45ab-4cac-8e87-7fa5fbd1a0e1 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:09 devstack sudo[112102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e475f950-45ab-4cac-8e87-7fa5fbd1a0e1 Jun 30 16:27:09 devstack sudo[112102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:09 devstack sudo[112100]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f82c745d-6eed-4e9c-b177-1fd7df8f2c0f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.959s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:09 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-f82c745d-6eed-4e9c-b177-1fd7df8f2c0f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:27:09 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-f82c745d-6eed-4e9c-b177-1fd7df8f2c0f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Deleted volume successfully. Jun 30 16:27:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f82c745d-6eed-4e9c-b177-1fd7df8f2c0f tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-f6d417ad-7c00-4564-b70c-8e83ee166ddb-delete_volume" released by "delete_volume" :: held 3.057s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:27:10 devstack sudo[112102]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c4b52c21-69d9-47a7-9e06-76583aa0b010 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e475f950-45ab-4cac-8e87-7fa5fbd1a0e1" returned: 0 in 1.132s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c4b52c21-69d9-47a7-9e06-76583aa0b010 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e475f950-45ab-4cac-8e87-7fa5fbd1a0e1 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:10 devstack sudo[112109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e475f950-45ab-4cac-8e87-7fa5fbd1a0e1 Jun 30 16:27:10 devstack sudo[112109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:10 devstack sudo[112109]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c4b52c21-69d9-47a7-9e06-76583aa0b010 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-e475f950-45ab-4cac-8e87-7fa5fbd1a0e1" returned: 0 in 0.780s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:10 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c4b52c21-69d9-47a7-9e06-76583aa0b010 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-quobyte-e475f950-45ab-4cac-8e87-7fa5fbd1a0e1" released by "delete_volume" :: held 1.967s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:27:11 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-c4b52c21-69d9-47a7-9e06-76583aa0b010 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Created reservations ['c0a7562a-9f3a-4fa6-afd5-89a8e04f710e', '4e10b1d6-bdd8-4af1-988d-75a85a37e471', '92759705-ccbe-4f8f-8b22-7ffaf10bd768', '311441c7-bd70-4dd6-b0db-521fba59b079'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:27:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c4b52c21-69d9-47a7-9e06-76583aa0b010 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:27:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c4b52c21-69d9-47a7-9e06-76583aa0b010 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:27:11 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c4b52c21-69d9-47a7-9e06-76583aa0b010 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:27:11 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c4b52c21-69d9-47a7-9e06-76583aa0b010 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:27:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c4b52c21-69d9-47a7-9e06-76583aa0b010 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:27:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c4b52c21-69d9-47a7-9e06-76583aa0b010 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:11 devstack sudo[112148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:27:11 devstack sudo[112148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:11 devstack sudo[112148]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c4b52c21-69d9-47a7-9e06-76583aa0b010 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.740s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:11 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-c4b52c21-69d9-47a7-9e06-76583aa0b010 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:27:11 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-c4b52c21-69d9-47a7-9e06-76583aa0b010 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Deleted volume successfully. Jun 30 16:27:11 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c4b52c21-69d9-47a7-9e06-76583aa0b010 tempest-CreateVolumesFromSourceVolumeTest-1857303339 None] Lock "cinder-e475f950-45ab-4cac-8e87-7fa5fbd1a0e1-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:27:15 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:27:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Flow 'volume_create_manager' (24c5b1de-f475-4f0a-8ea5-7f51da187ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:27:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584fbdee-4b8e-4999-b29f-940fc35bda9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:27:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584fbdee-4b8e-4999-b29f-940fc35bda9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783fc720-15f1-4671-b718-e338576c718b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efce4cf8f9234dc7a0ed65cd07dec39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:27:16Z,use_quota=True,user_id='9cc5f84258fb4ea893056bdac08cc07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:27:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (741babd4-0167-4c0c-87d8-f3e84b5494c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:27:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (741babd4-0167-4c0c-87d8-f3e84b5494c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:27:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea24b73-2726-42a4-891b-8d7e7bfd8995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea24b73-2726-42a4-891b-8d7e7bfd8995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '783fc720-15f1-4671-b718-e338576c718b', 'volume_name': 'volume-783fc720-15f1-4671-b718-e338576c718b', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eb58d55-fd14-4961-8cf7-6b4ffda90c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eb58d55-fd14-4961-8cf7-6b4ffda90c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a690d127-df04-4f1c-acc9-d9888b291ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:27:16 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Volume 783fc720-15f1-4671-b718-e338576c718b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-783fc720-15f1-4671-b718-e338576c718b', 'volume_size': 1} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783fc720-15f1-4671-b718-e338576c718b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efce4cf8f9234dc7a0ed65cd07dec39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:27:16Z,use_quota=True,user_id='9cc5f84258fb4ea893056bdac08cc07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Creating volume 783fc720-15f1-4671-b718-e338576c718b {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:27:16 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-783fc720-15f1-4671-b718-e338576c718b 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:16 devstack sudo[112151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-783fc720-15f1-4671-b718-e338576c718b 1073741824 Jun 30 16:27:16 devstack sudo[112151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Flow 'volume_create_manager' (12ac88a2-9c96-4fe3-8831-7d399a5f3e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c9beb1-6878-492f-a61b-7ab7af9b1f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c9beb1-6878-492f-a61b-7ab7af9b1f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-189484250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45009935-e5be-45f1-afb7-af3dcd19075c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fdc6ac6ace4bd29c8a0f7825ce3b74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:27:17Z,use_quota=True,user_id='1cb6b75edefe48dba18fb5b92d8c2b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4821bdab-d1e0-423e-abde-906ba29d3426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4821bdab-d1e0-423e-abde-906ba29d3426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aaa0530-b533-4482-86c0-80dd365688b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aaa0530-b533-4482-86c0-80dd365688b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45009935-e5be-45f1-afb7-af3dcd19075c', 'volume_name': 'volume-45009935-e5be-45f1-afb7-af3dcd19075c', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d99d50-8d83-4c71-b52e-b11aae02659a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d99d50-8d83-4c71-b52e-b11aae02659a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db2cb830-1509-447a-a7da-7d55d7fc8d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:27:16 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Volume 45009935-e5be-45f1-afb7-af3dcd19075c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45009935-e5be-45f1-afb7-af3dcd19075c', 'volume_size': 1} Jun 30 16:27:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:27:17 devstack sudo[112151]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-783fc720-15f1-4671-b718-e338576c718b 1073741824" returned: 0 in 1.019s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-783fc720-15f1-4671-b718-e338576c718b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:17 devstack sudo[112158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-783fc720-15f1-4671-b718-e338576c718b Jun 30 16:27:17 devstack sudo[112158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:17 devstack sudo[112158]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-783fc720-15f1-4671-b718-e338576c718b" returned: 0 in 0.720s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:27:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:27:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.116s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:27:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-189484250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45009935-e5be-45f1-afb7-af3dcd19075c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fdc6ac6ace4bd29c8a0f7825ce3b74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:27:17Z,use_quota=True,user_id='1cb6b75edefe48dba18fb5b92d8c2b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:27:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Creating volume 45009935-e5be-45f1-afb7-af3dcd19075c {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:27:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:27:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:27:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:27:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:27:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:27:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:27:17 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:27:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:17 devstack sudo[112164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c 1073741824 Jun 30 16:27:17 devstack sudo[112164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a690d127-df04-4f1c-acc9-d9888b291ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-783fc720-15f1-4671-b718-e338576c718b', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:27:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d806808b-8dfb-46b2-b554-dd58a233e1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:27:17 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Volume volume-783fc720-15f1-4671-b718-e338576c718b (783fc720-15f1-4671-b718-e338576c718b): created successfully Jun 30 16:27:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d806808b-8dfb-46b2-b554-dd58a233e1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:27:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Flow 'volume_create_manager' (24c5b1de-f475-4f0a-8ea5-7f51da187ef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:27:17 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-131c9bda-b6d9-497d-ad3e-f716adebf4a6 tempest-CinderUnicodeTest-1440623717 None] Created volume successfully. Jun 30 16:27:18 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:27:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Flow 'volume_create_manager' (cb6c404f-4546-4259-a279-e117146b0be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:27:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a28a4bd2-0c22-4e52-acee-e18bd05bbc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:27:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a28a4bd2-0c22-4e52-acee-e18bd05bbc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:27:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-288788110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ad6e80-3983-4fc3-a2f9-1b59918e5744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efce4cf8f9234dc7a0ed65cd07dec39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:27:19Z,use_quota=True,user_id='9cc5f84258fb4ea893056bdac08cc07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:27:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f35cb3-4b45-4c24-a026-973b27a58b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:27:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f35cb3-4b45-4c24-a026-973b27a58b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:27:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e957271-c294-49cf-9491-c0864686aa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:27:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e957271-c294-49cf-9491-c0864686aa89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75ad6e80-3983-4fc3-a2f9-1b59918e5744', 'volume_name': 'volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:27:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07ce735-ad13-4e7a-a76f-565adc6bcbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:27:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07ce735-ad13-4e7a-a76f-565adc6bcbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:27:18 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50ceb5e-8ecc-44bb-b34e-0426e3766342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:27:18 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Volume 75ad6e80-3983-4fc3-a2f9-1b59918e5744: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744', 'volume_size': 1} Jun 30 16:27:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:27:18 devstack sudo[112164]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c 1073741824" returned: 0 in 1.161s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:19 devstack sudo[112170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c Jun 30 16:27:19 devstack sudo[112170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:19 devstack sudo[112170]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c" returned: 0 in 0.699s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:27:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:27:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.997s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:27:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:27:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-288788110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ad6e80-3983-4fc3-a2f9-1b59918e5744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efce4cf8f9234dc7a0ed65cd07dec39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:27:19Z,use_quota=True,user_id='9cc5f84258fb4ea893056bdac08cc07e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:27:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Creating volume 75ad6e80-3983-4fc3-a2f9-1b59918e5744 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:27:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:27:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:27:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:27:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:27:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:27:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:27:19 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:27:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:19 devstack sudo[112173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744 1073741824 Jun 30 16:27:19 devstack sudo[112173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db2cb830-1509-447a-a7da-7d55d7fc8d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45009935-e5be-45f1-afb7-af3dcd19075c', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:27:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0cde49-0744-4b43-9289-b11c9c5bd281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:27:19 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Volume volume-45009935-e5be-45f1-afb7-af3dcd19075c (45009935-e5be-45f1-afb7-af3dcd19075c): created successfully Jun 30 16:27:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0cde49-0744-4b43-9289-b11c9c5bd281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:27:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Flow 'volume_create_manager' (12ac88a2-9c96-4fe3-8831-7d399a5f3e73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:27:19 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-e6564e93-56dd-4d15-b12d-f7b45722ff28 tempest-TestStampPattern-1149007075 None] Created volume successfully. Jun 30 16:27:20 devstack sudo[112173]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744 1073741824" returned: 0 in 0.958s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:20 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=57,cinder:UPDATE=92,cinder:INSERT=17,cinder:DELETE=11 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:27:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:20 devstack sudo[112178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744 Jun 30 16:27:20 devstack sudo[112178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:21 devstack sudo[112178]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744" returned: 0 in 0.669s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:27:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:27:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50ceb5e-8ecc-44bb-b34e-0426e3766342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:27:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ba4431-102a-4a69-9abf-94fab84b5f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:27:21 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Volume volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744 (75ad6e80-3983-4fc3-a2f9-1b59918e5744): created successfully Jun 30 16:27:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ba4431-102a-4a69-9abf-94fab84b5f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:27:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Flow 'volume_create_manager' (cb6c404f-4546-4259-a279-e117146b0be7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:27:21 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-56951b28-f0db-4663-881d-24fa6f158db5 tempest-CinderUnicodeTest-1440623717 None] Created volume successfully. Jun 30 16:27:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7384bb54-7d51-41d0-a5ff-df22bbf25c8c tempest-CinderUnicodeTest-1440623717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:27:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7384bb54-7d51-41d0-a5ff-df22bbf25c8c tempest-CinderUnicodeTest-1440623717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:27:22 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-7384bb54-7d51-41d0-a5ff-df22bbf25c8c tempest-CinderUnicodeTest-1440623717 None] Creating offline snapshot 284ed2e0-d5a5-415a-8ecc-e43eab9bae01 of volume 75ad6e80-3983-4fc3-a2f9-1b59918e5744 {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:27:22 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[e466b392-09cf-452f-823f-0c89802c86e5]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:27:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7384bb54-7d51-41d0-a5ff-df22bbf25c8c tempest-CinderUnicodeTest-1440623717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:22 devstack sudo[112181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744 Jun 30 16:27:22 devstack sudo[112181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:23 devstack sudo[112181]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7384bb54-7d51-41d0-a5ff-df22bbf25c8c tempest-CinderUnicodeTest-1440623717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744" returned: 0 in 0.873s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7384bb54-7d51-41d0-a5ff-df22bbf25c8c tempest-CinderUnicodeTest-1440623717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.284ed2e0-d5a5-415a-8ecc-e43eab9bae01 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:23 devstack sudo[112186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.284ed2e0-d5a5-415a-8ecc-e43eab9bae01 1G Jun 30 16:27:23 devstack sudo[112186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:24 devstack sudo[112186]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7384bb54-7d51-41d0-a5ff-df22bbf25c8c tempest-CinderUnicodeTest-1440623717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.284ed2e0-d5a5-415a-8ecc-e43eab9bae01 1G" returned: 0 in 1.089s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7384bb54-7d51-41d0-a5ff-df22bbf25c8c tempest-CinderUnicodeTest-1440623717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.284ed2e0-d5a5-415a-8ecc-e43eab9bae01 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:24 devstack sudo[112192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.284ed2e0-d5a5-415a-8ecc-e43eab9bae01 Jun 30 16:27:24 devstack sudo[112192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:24 devstack sudo[112192]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7384bb54-7d51-41d0-a5ff-df22bbf25c8c tempest-CinderUnicodeTest-1440623717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.284ed2e0-d5a5-415a-8ecc-e43eab9bae01" returned: 0 in 0.843s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:24 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-7384bb54-7d51-41d0-a5ff-df22bbf25c8c tempest-CinderUnicodeTest-1440623717 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.284ed2e0-d5a5-415a-8ecc-e43eab9bae01 is being set with open permissions: ugo+rw Jun 30 16:27:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7384bb54-7d51-41d0-a5ff-df22bbf25c8c tempest-CinderUnicodeTest-1440623717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.284ed2e0-d5a5-415a-8ecc-e43eab9bae01 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:25 devstack sudo[112198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.284ed2e0-d5a5-415a-8ecc-e43eab9bae01 Jun 30 16:27:25 devstack sudo[112198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:25 devstack sudo[112198]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7384bb54-7d51-41d0-a5ff-df22bbf25c8c tempest-CinderUnicodeTest-1440623717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.284ed2e0-d5a5-415a-8ecc-e43eab9bae01" returned: 0 in 0.848s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7384bb54-7d51-41d0-a5ff-df22bbf25c8c tempest-CinderUnicodeTest-1440623717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:25 devstack sudo[112216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.info Jun 30 16:27:25 devstack sudo[112216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:26 devstack sudo[112216]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7384bb54-7d51-41d0-a5ff-df22bbf25c8c tempest-CinderUnicodeTest-1440623717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.info" returned: 0 in 0.829s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:26 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-7384bb54-7d51-41d0-a5ff-df22bbf25c8c tempest-CinderUnicodeTest-1440623717 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.info is being set with open permissions: ugo+rw Jun 30 16:27:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7384bb54-7d51-41d0-a5ff-df22bbf25c8c tempest-CinderUnicodeTest-1440623717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:26 devstack sudo[112219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.info Jun 30 16:27:26 devstack sudo[112219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:27 devstack sudo[112219]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7384bb54-7d51-41d0-a5ff-df22bbf25c8c tempest-CinderUnicodeTest-1440623717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.info" returned: 0 in 0.732s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7384bb54-7d51-41d0-a5ff-df22bbf25c8c tempest-CinderUnicodeTest-1440623717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.323s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:27:27 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-7384bb54-7d51-41d0-a5ff-df22bbf25c8c tempest-CinderUnicodeTest-1440623717 None] Create snapshot completed successfully Jun 30 16:27:28 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1063a57d-20f7-4689-b16d-68a3ba86126f tempest-CinderUnicodeTest-1440623717 None] Acquiring lock "cinder-284ed2e0-d5a5-415a-8ecc-e43eab9bae01-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:27:28 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1063a57d-20f7-4689-b16d-68a3ba86126f tempest-CinderUnicodeTest-1440623717 None] Lock "cinder-284ed2e0-d5a5-415a-8ecc-e43eab9bae01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:27:28 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1063a57d-20f7-4689-b16d-68a3ba86126f tempest-CinderUnicodeTest-1440623717 None] Acquiring lock "cinder-quobyte-75ad6e80-3983-4fc3-a2f9-1b59918e5744" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:27:28 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1063a57d-20f7-4689-b16d-68a3ba86126f tempest-CinderUnicodeTest-1440623717 None] Lock "cinder-quobyte-75ad6e80-3983-4fc3-a2f9-1b59918e5744" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:27:28 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1063a57d-20f7-4689-b16d-68a3ba86126f tempest-CinderUnicodeTest-1440623717 None] Acquiring lock "cinder-quobyte-284ed2e0-d5a5-415a-8ecc-e43eab9bae01" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:27:28 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1063a57d-20f7-4689-b16d-68a3ba86126f tempest-CinderUnicodeTest-1440623717 None] Lock "cinder-quobyte-284ed2e0-d5a5-415a-8ecc-e43eab9bae01" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:27:28 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-1063a57d-20f7-4689-b16d-68a3ba86126f tempest-CinderUnicodeTest-1440623717 None] Deleting offline snapshot 284ed2e0-d5a5-415a-8ecc-e43eab9bae01 of volume 75ad6e80-3983-4fc3-a2f9-1b59918e5744 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:27:28 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-1063a57d-20f7-4689-b16d-68a3ba86126f tempest-CinderUnicodeTest-1440623717 None] snapshot_file for this snap is: volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.284ed2e0-d5a5-415a-8ecc-e43eab9bae01 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:27:28 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c406c21-f28b-4e7f-9e15-6e83db2dd8f0]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:27:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1063a57d-20f7-4689-b16d-68a3ba86126f tempest-CinderUnicodeTest-1440623717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.284ed2e0-d5a5-415a-8ecc-e43eab9bae01 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:28 devstack sudo[112223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.284ed2e0-d5a5-415a-8ecc-e43eab9bae01 Jun 30 16:27:28 devstack sudo[112223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:29 devstack sudo[112223]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1063a57d-20f7-4689-b16d-68a3ba86126f tempest-CinderUnicodeTest-1440623717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.284ed2e0-d5a5-415a-8ecc-e43eab9bae01" returned: 0 in 0.934s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-1063a57d-20f7-4689-b16d-68a3ba86126f tempest-CinderUnicodeTest-1440623717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:27:29 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b66acf3-a421-4927-a2f3-b4f6a1d6aa69]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:27:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1063a57d-20f7-4689-b16d-68a3ba86126f tempest-CinderUnicodeTest-1440623717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:29 devstack sudo[112231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744 Jun 30 16:27:29 devstack sudo[112231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:30 devstack sudo[112231]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1063a57d-20f7-4689-b16d-68a3ba86126f tempest-CinderUnicodeTest-1440623717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744" returned: 0 in 0.999s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1063a57d-20f7-4689-b16d-68a3ba86126f tempest-CinderUnicodeTest-1440623717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.284ed2e0-d5a5-415a-8ecc-e43eab9bae01 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:30 devstack sudo[112242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.284ed2e0-d5a5-415a-8ecc-e43eab9bae01 Jun 30 16:27:30 devstack sudo[112242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:31 devstack sudo[112242]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1063a57d-20f7-4689-b16d-68a3ba86126f tempest-CinderUnicodeTest-1440623717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.284ed2e0-d5a5-415a-8ecc-e43eab9bae01" returned: 0 in 1.291s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1063a57d-20f7-4689-b16d-68a3ba86126f tempest-CinderUnicodeTest-1440623717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.284ed2e0-d5a5-415a-8ecc-e43eab9bae01 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:31 devstack sudo[112313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.284ed2e0-d5a5-415a-8ecc-e43eab9bae01 Jun 30 16:27:31 devstack sudo[112313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:32 devstack sudo[112313]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1063a57d-20f7-4689-b16d-68a3ba86126f tempest-CinderUnicodeTest-1440623717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744.284ed2e0-d5a5-415a-8ecc-e43eab9bae01" returned: 0 in 1.039s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:32 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1063a57d-20f7-4689-b16d-68a3ba86126f tempest-CinderUnicodeTest-1440623717 None] Lock "cinder-quobyte-284ed2e0-d5a5-415a-8ecc-e43eab9bae01" released by "_delete_snapshot" :: held 4.436s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:27:32 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1063a57d-20f7-4689-b16d-68a3ba86126f tempest-CinderUnicodeTest-1440623717 None] Lock "cinder-quobyte-75ad6e80-3983-4fc3-a2f9-1b59918e5744" released by "delete_snapshot" :: held 4.464s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:27:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:27:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:27:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:27:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:27:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:27:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:27:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:33 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-1063a57d-20f7-4689-b16d-68a3ba86126f tempest-CinderUnicodeTest-1440623717 None] Created reservations ['6ee580e6-a78b-466e-bd50-e5164ab960d3', '185762f8-3d2f-4dde-b355-97b835ad6bfc', '56db2111-fd70-450b-ad4c-e13b942688b2', '5e4a45d6-dd1c-47a2-9fb5-2ec217740e4e'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:27:33 devstack sudo[112327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:27:33 devstack sudo[112327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:33 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-1063a57d-20f7-4689-b16d-68a3ba86126f tempest-CinderUnicodeTest-1440623717 None] Delete snapshot completed successfully. Jun 30 16:27:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1063a57d-20f7-4689-b16d-68a3ba86126f tempest-CinderUnicodeTest-1440623717 None] Lock "cinder-284ed2e0-d5a5-415a-8ecc-e43eab9bae01-delete_snapshot" released by "delete_snapshot" :: held 4.710s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:27:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-008a3c11-e95b-4513-b557-6bdce8f433e5 tempest-CinderUnicodeTest-1440623717 None] Acquiring lock "cinder-75ad6e80-3983-4fc3-a2f9-1b59918e5744-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:27:33 devstack sudo[112327]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-008a3c11-e95b-4513-b557-6bdce8f433e5 tempest-CinderUnicodeTest-1440623717 None] Lock "cinder-75ad6e80-3983-4fc3-a2f9-1b59918e5744-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:27:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.880s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:33 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:27:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:27:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 28 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:27:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:27:34 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-008a3c11-e95b-4513-b557-6bdce8f433e5 tempest-CinderUnicodeTest-1440623717 None] Acquiring lock "cinder-quobyte-75ad6e80-3983-4fc3-a2f9-1b59918e5744" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:27:34 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-008a3c11-e95b-4513-b557-6bdce8f433e5 tempest-CinderUnicodeTest-1440623717 None] Lock "cinder-quobyte-75ad6e80-3983-4fc3-a2f9-1b59918e5744" acquired by "delete_volume" :: waited 0.022s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:27:34 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afe3a55-19bf-42a0-b91b-600462683693]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:27:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-008a3c11-e95b-4513-b557-6bdce8f433e5 tempest-CinderUnicodeTest-1440623717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:34 devstack sudo[112330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744 Jun 30 16:27:34 devstack sudo[112330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:35 devstack sudo[112330]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-008a3c11-e95b-4513-b557-6bdce8f433e5 tempest-CinderUnicodeTest-1440623717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744" returned: 0 in 1.125s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-008a3c11-e95b-4513-b557-6bdce8f433e5 tempest-CinderUnicodeTest-1440623717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:35 devstack sudo[112335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744 Jun 30 16:27:35 devstack sudo[112335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:36 devstack sudo[112335]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-008a3c11-e95b-4513-b557-6bdce8f433e5 tempest-CinderUnicodeTest-1440623717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-75ad6e80-3983-4fc3-a2f9-1b59918e5744" returned: 0 in 0.909s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:36 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-008a3c11-e95b-4513-b557-6bdce8f433e5 tempest-CinderUnicodeTest-1440623717 None] Lock "cinder-quobyte-75ad6e80-3983-4fc3-a2f9-1b59918e5744" released by "delete_volume" :: held 2.154s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:27:36 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-008a3c11-e95b-4513-b557-6bdce8f433e5 tempest-CinderUnicodeTest-1440623717 None] Created reservations ['c3a12471-b881-4766-8798-ff6b288a1ccc', 'd0ea14fe-9398-48d3-a030-ecf5a30bc1d3', '0e5ba0e3-b51b-4a44-b5f0-3ef2f8ef10b4', '09c5d4d9-c332-4fbd-a0ce-a2f7d89bc747'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:27:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-008a3c11-e95b-4513-b557-6bdce8f433e5 tempest-CinderUnicodeTest-1440623717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:27:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-008a3c11-e95b-4513-b557-6bdce8f433e5 tempest-CinderUnicodeTest-1440623717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:27:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-008a3c11-e95b-4513-b557-6bdce8f433e5 tempest-CinderUnicodeTest-1440623717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:27:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-008a3c11-e95b-4513-b557-6bdce8f433e5 tempest-CinderUnicodeTest-1440623717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:27:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-008a3c11-e95b-4513-b557-6bdce8f433e5 tempest-CinderUnicodeTest-1440623717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:27:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-008a3c11-e95b-4513-b557-6bdce8f433e5 tempest-CinderUnicodeTest-1440623717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:36 devstack sudo[112338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:27:36 devstack sudo[112338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:37 devstack sudo[112338]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-008a3c11-e95b-4513-b557-6bdce8f433e5 tempest-CinderUnicodeTest-1440623717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.694s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:37 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-008a3c11-e95b-4513-b557-6bdce8f433e5 tempest-CinderUnicodeTest-1440623717 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:27:37 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-008a3c11-e95b-4513-b557-6bdce8f433e5 tempest-CinderUnicodeTest-1440623717 None] Deleted volume successfully. Jun 30 16:27:37 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-008a3c11-e95b-4513-b557-6bdce8f433e5 tempest-CinderUnicodeTest-1440623717 None] Lock "cinder-75ad6e80-3983-4fc3-a2f9-1b59918e5744-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:27:37 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-305c794a-2d49-433d-ac47-df58d70b8639 tempest-CinderUnicodeTest-1440623717 None] Acquiring lock "cinder-783fc720-15f1-4671-b718-e338576c718b-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:27:37 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-305c794a-2d49-433d-ac47-df58d70b8639 tempest-CinderUnicodeTest-1440623717 None] Lock "cinder-783fc720-15f1-4671-b718-e338576c718b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:27:37 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-305c794a-2d49-433d-ac47-df58d70b8639 tempest-CinderUnicodeTest-1440623717 None] Acquiring lock "cinder-quobyte-783fc720-15f1-4671-b718-e338576c718b" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:27:37 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-305c794a-2d49-433d-ac47-df58d70b8639 tempest-CinderUnicodeTest-1440623717 None] Lock "cinder-quobyte-783fc720-15f1-4671-b718-e338576c718b" acquired by "delete_volume" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:27:37 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd61779-71e9-4f63-a6ad-a26e5cd77746]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:27:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-305c794a-2d49-433d-ac47-df58d70b8639 tempest-CinderUnicodeTest-1440623717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-783fc720-15f1-4671-b718-e338576c718b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:37 devstack sudo[112343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-783fc720-15f1-4671-b718-e338576c718b Jun 30 16:27:37 devstack sudo[112343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:38 devstack sudo[112343]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-305c794a-2d49-433d-ac47-df58d70b8639 tempest-CinderUnicodeTest-1440623717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-783fc720-15f1-4671-b718-e338576c718b" returned: 0 in 0.889s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-305c794a-2d49-433d-ac47-df58d70b8639 tempest-CinderUnicodeTest-1440623717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-783fc720-15f1-4671-b718-e338576c718b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:38 devstack sudo[112349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-783fc720-15f1-4671-b718-e338576c718b Jun 30 16:27:38 devstack sudo[112349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:39 devstack sudo[112349]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-305c794a-2d49-433d-ac47-df58d70b8639 tempest-CinderUnicodeTest-1440623717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-783fc720-15f1-4671-b718-e338576c718b" returned: 0 in 0.908s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-305c794a-2d49-433d-ac47-df58d70b8639 tempest-CinderUnicodeTest-1440623717 None] Lock "cinder-quobyte-783fc720-15f1-4671-b718-e338576c718b" released by "delete_volume" :: held 1.861s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:27:39 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-305c794a-2d49-433d-ac47-df58d70b8639 tempest-CinderUnicodeTest-1440623717 None] Created reservations ['110a0938-b662-4400-bdc5-c588df1868c9', 'deffc92f-0fca-42a1-b05d-81b46e661e63', '6365ca03-6990-4bc9-af46-0bd074ac27ee', '9044f24f-de98-40fb-a083-01da0ee2db9d'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:27:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-305c794a-2d49-433d-ac47-df58d70b8639 tempest-CinderUnicodeTest-1440623717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:27:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-305c794a-2d49-433d-ac47-df58d70b8639 tempest-CinderUnicodeTest-1440623717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:27:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-305c794a-2d49-433d-ac47-df58d70b8639 tempest-CinderUnicodeTest-1440623717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:27:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-305c794a-2d49-433d-ac47-df58d70b8639 tempest-CinderUnicodeTest-1440623717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:27:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-305c794a-2d49-433d-ac47-df58d70b8639 tempest-CinderUnicodeTest-1440623717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:27:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-305c794a-2d49-433d-ac47-df58d70b8639 tempest-CinderUnicodeTest-1440623717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:27:39 devstack sudo[112352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:27:39 devstack sudo[112352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:27:40 devstack sudo[112352]: pam_unix(sudo:session): session closed for user root Jun 30 16:27:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-305c794a-2d49-433d-ac47-df58d70b8639 tempest-CinderUnicodeTest-1440623717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.823s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:27:40 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-305c794a-2d49-433d-ac47-df58d70b8639 tempest-CinderUnicodeTest-1440623717 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:27:40 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-305c794a-2d49-433d-ac47-df58d70b8639 tempest-CinderUnicodeTest-1440623717 None] Deleted volume successfully. Jun 30 16:27:40 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-305c794a-2d49-433d-ac47-df58d70b8639 tempest-CinderUnicodeTest-1440623717 None] Lock "cinder-783fc720-15f1-4671-b718-e338576c718b-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:27:49 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:UPDATE=70,cinder:SELECT=43,cinder:INSERT=18,cinder:DELETE=1 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:27:50 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:UPDATE=26,cinder:DELETE=4,cinder:SELECT=22,cinder:INSERT=7 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:28:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-7c098f74-bca0-4e40-9574-d17e903d3e19 req-2680f14b-516d-45f9-a98c-9e83f7c5c8fc tempest-TestStampPattern-1149007075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:28:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-7c098f74-bca0-4e40-9574-d17e903d3e19 req-2680f14b-516d-45f9-a98c-9e83f7c5c8fc tempest-TestStampPattern-1149007075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:28:01 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[37568298-8e81-401b-a1f7-3ff3cd8fdd39]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:28:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-7c098f74-bca0-4e40-9574-d17e903d3e19 req-2680f14b-516d-45f9-a98c-9e83f7c5c8fc tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:01 devstack sudo[112405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c Jun 30 16:28:01 devstack sudo[112405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:02 devstack sudo[112405]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-7c098f74-bca0-4e40-9574-d17e903d3e19 req-2680f14b-516d-45f9-a98c-9e83f7c5c8fc tempest-TestStampPattern-1149007075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c" returned: 0 in 1.029s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-7c098f74-bca0-4e40-9574-d17e903d3e19 req-2680f14b-516d-45f9-a98c-9e83f7c5c8fc tempest-TestStampPattern-1149007075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.068s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:28:02 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-7c098f74-bca0-4e40-9574-d17e903d3e19 req-2680f14b-516d-45f9-a98c-9e83f7c5c8fc tempest-TestStampPattern-1149007075 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a', 'name': 'volume-45009935-e5be-45f1-afb7-af3dcd19075c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b57b27fa-c788-43f2-93b5-0632657a3fd0', 'enforce_multipath': True} {{(pid=93781) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 30 16:28:02 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-7c098f74-bca0-4e40-9574-d17e903d3e19 req-2680f14b-516d-45f9-a98c-9e83f7c5c8fc tempest-TestStampPattern-1149007075 None] attachment_update completed successfully. Jun 30 16:28:07 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:28:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Flow 'volume_create_manager' (7eb985c5-e1b2-4513-8130-b15cc00f64fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:28:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f47fe74-ed2a-44c9-919c-c1e5689503d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:28:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f47fe74-ed2a-44c9-919c-c1e5689503d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-666888229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5827c57f-a2d5-430f-9018-010eff45677b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324057629a1145ca815648aed915407d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:28:08Z,use_quota=True,user_id='f520695f77c644eca309aa9d217d5ba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:28:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e7d5063-7860-4c46-9381-55943a4bb2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:28:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e7d5063-7860-4c46-9381-55943a4bb2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:28:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7cff24-f3e6-464c-b306-0f6a9d2e8970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:28:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7cff24-f3e6-464c-b306-0f6a9d2e8970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5827c57f-a2d5-430f-9018-010eff45677b', 'volume_name': 'volume-5827c57f-a2d5-430f-9018-010eff45677b', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:28:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45afb8d1-e940-4dec-9032-49b8ab1ed75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:28:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45afb8d1-e940-4dec-9032-49b8ab1ed75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:28:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fafe13-caf4-448c-9520-96559d31b7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:28:07 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Volume 5827c57f-a2d5-430f-9018-010eff45677b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5827c57f-a2d5-430f-9018-010eff45677b', 'volume_size': 1} Jun 30 16:28:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:28:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:28:07 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-666888229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5827c57f-a2d5-430f-9018-010eff45677b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324057629a1145ca815648aed915407d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:28:08Z,use_quota=True,user_id='f520695f77c644eca309aa9d217d5ba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:28:07 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Creating volume 5827c57f-a2d5-430f-9018-010eff45677b {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:28:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:28:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:28:07 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:28:07 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:28:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:28:07 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:28:07 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:28:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:07 devstack sudo[112799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b 1073741824 Jun 30 16:28:07 devstack sudo[112799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:08 devstack sudo[112799]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b 1073741824" returned: 0 in 0.995s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:08 devstack sudo[112815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b Jun 30 16:28:08 devstack sudo[112815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:09 devstack sudo[112815]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b" returned: 0 in 0.746s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:09 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:28:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:28:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fafe13-caf4-448c-9520-96559d31b7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5827c57f-a2d5-430f-9018-010eff45677b', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:28:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc78bad3-0ab0-4a06-b10b-a56c0a1b7147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:28:09 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Volume volume-5827c57f-a2d5-430f-9018-010eff45677b (5827c57f-a2d5-430f-9018-010eff45677b): created successfully Jun 30 16:28:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc78bad3-0ab0-4a06-b10b-a56c0a1b7147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:28:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Flow 'volume_create_manager' (7eb985c5-e1b2-4513-8130-b15cc00f64fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:28:09 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-1f239f1c-887d-4be0-ae06-90f52060a214 tempest-SnapshotDependencyTests-1906162278 None] Created volume successfully. Jun 30 16:28:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a82c205a-978b-4eed-a288-ec74d4de9335 tempest-SnapshotDependencyTests-1906162278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:28:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a82c205a-978b-4eed-a288-ec74d4de9335 tempest-SnapshotDependencyTests-1906162278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:28:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-a82c205a-978b-4eed-a288-ec74d4de9335 tempest-SnapshotDependencyTests-1906162278 None] Creating offline snapshot ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b of volume 5827c57f-a2d5-430f-9018-010eff45677b {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:28:10 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c936ed5-ee2f-478a-a276-4cc35f9e5cb7]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:28:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a82c205a-978b-4eed-a288-ec74d4de9335 tempest-SnapshotDependencyTests-1906162278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:10 devstack sudo[112818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b Jun 30 16:28:10 devstack sudo[112818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:11 devstack sudo[112818]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a82c205a-978b-4eed-a288-ec74d4de9335 tempest-SnapshotDependencyTests-1906162278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b" returned: 0 in 0.908s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a82c205a-978b-4eed-a288-ec74d4de9335 tempest-SnapshotDependencyTests-1906162278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:11 devstack sudo[112869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b 1G Jun 30 16:28:11 devstack sudo[112869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:12 devstack sudo[112869]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a82c205a-978b-4eed-a288-ec74d4de9335 tempest-SnapshotDependencyTests-1906162278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b 1G" returned: 0 in 0.903s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a82c205a-978b-4eed-a288-ec74d4de9335 tempest-SnapshotDependencyTests-1906162278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5827c57f-a2d5-430f-9018-010eff45677b -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:12 devstack sudo[112877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5827c57f-a2d5-430f-9018-010eff45677b -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b Jun 30 16:28:12 devstack sudo[112877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:12 devstack sudo[112877]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a82c205a-978b-4eed-a288-ec74d4de9335 tempest-SnapshotDependencyTests-1906162278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5827c57f-a2d5-430f-9018-010eff45677b -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b" returned: 0 in 0.847s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:12 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-a82c205a-978b-4eed-a288-ec74d4de9335 tempest-SnapshotDependencyTests-1906162278 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b is being set with open permissions: ugo+rw Jun 30 16:28:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a82c205a-978b-4eed-a288-ec74d4de9335 tempest-SnapshotDependencyTests-1906162278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:12 devstack sudo[112913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b Jun 30 16:28:12 devstack sudo[112913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:12 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-75c37527-78cf-4de2-afac-4af087646969 req-6bc03334-4497-4ad7-8a1b-931d3c9c5cda tempest-TestStampPattern-1149007075 None] Terminate volume connection completed successfully. Jun 30 16:28:12 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-75c37527-78cf-4de2-afac-4af087646969 req-6bc03334-4497-4ad7-8a1b-931d3c9c5cda tempest-TestStampPattern-1149007075 None] Deleting attachment b57b27fa-c788-43f2-93b5-0632657a3fd0. {{(pid=93781) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 30 16:28:13 devstack sudo[112913]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a82c205a-978b-4eed-a288-ec74d4de9335 tempest-SnapshotDependencyTests-1906162278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b" returned: 0 in 0.778s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a82c205a-978b-4eed-a288-ec74d4de9335 tempest-SnapshotDependencyTests-1906162278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:13 devstack sudo[112916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.info Jun 30 16:28:13 devstack sudo[112916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:14 devstack sudo[112916]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a82c205a-978b-4eed-a288-ec74d4de9335 tempest-SnapshotDependencyTests-1906162278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.info" returned: 0 in 0.776s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:14 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-a82c205a-978b-4eed-a288-ec74d4de9335 tempest-SnapshotDependencyTests-1906162278 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.info is being set with open permissions: ugo+rw Jun 30 16:28:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a82c205a-978b-4eed-a288-ec74d4de9335 tempest-SnapshotDependencyTests-1906162278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:14 devstack sudo[112919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.info Jun 30 16:28:14 devstack sudo[112919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3c4bf2f7-4d4e-4ce1-8b37-ca7802057284 tempest-TestStampPattern-1149007075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:28:15 devstack sudo[112919]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a82c205a-978b-4eed-a288-ec74d4de9335 tempest-SnapshotDependencyTests-1906162278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.info" returned: 0 in 0.737s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a82c205a-978b-4eed-a288-ec74d4de9335 tempest-SnapshotDependencyTests-1906162278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.058s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:28:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3c4bf2f7-4d4e-4ce1-8b37-ca7802057284 tempest-TestStampPattern-1149007075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.244s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:28:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-3c4bf2f7-4d4e-4ce1-8b37-ca7802057284 tempest-TestStampPattern-1149007075 None] Creating offline snapshot aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba of volume 45009935-e5be-45f1-afb7-af3dcd19075c {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:28:15 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-a82c205a-978b-4eed-a288-ec74d4de9335 tempest-SnapshotDependencyTests-1906162278 None] Create snapshot completed successfully Jun 30 16:28:15 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e9f2cf-a5ed-458a-bc2d-ba9a3e92ad63]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:28:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3c4bf2f7-4d4e-4ce1-8b37-ca7802057284 tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:15 devstack sudo[112922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c Jun 30 16:28:15 devstack sudo[112922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:16 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:28:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Flow 'volume_create_manager' (100cb5c9-a3a5-40fa-8855-156110cc3acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:28:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65d2de0-26d9-4f0e-8707-8bc9e2d6f75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:28:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65d2de0-26d9-4f0e-8707-8bc9e2d6f75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9d0f2e-df39-48db-a29f-ef837ffe6552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324057629a1145ca815648aed915407d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:28:16Z,use_quota=True,user_id='f520695f77c644eca309aa9d217d5ba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:28:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdddded2-4f59-4105-a0f9-12855cda89d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:28:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdddded2-4f59-4105-a0f9-12855cda89d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:28:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a259753f-4038-4281-8cec-ae19c4a5ad84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:28:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a259753f-4038-4281-8cec-ae19c4a5ad84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3e9d0f2e-df39-48db-a29f-ef837ffe6552', 'volume_name': 'volume-3e9d0f2e-df39-48db-a29f-ef837ffe6552', 'volume_size': 1, 'snapshot_id': 'ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b'}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:28:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc7850b-e604-4969-956e-d20481e73200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:28:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc7850b-e604-4969-956e-d20481e73200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:28:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9e5d1a-7f5a-482e-a7f9-5cfc3f1e482c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:28:16 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Volume 3e9d0f2e-df39-48db-a29f-ef837ffe6552: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3e9d0f2e-df39-48db-a29f-ef837ffe6552', 'volume_size': 1, 'snapshot_id': 'ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b'} Jun 30 16:28:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:28:16 devstack sudo[112922]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3c4bf2f7-4d4e-4ce1-8b37-ca7802057284 tempest-TestStampPattern-1149007075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c" returned: 0 in 0.936s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3c4bf2f7-4d4e-4ce1-8b37-ca7802057284 tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:16 devstack sudo[112927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba 1G Jun 30 16:28:16 devstack sudo[112927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:17 devstack sudo[112927]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3c4bf2f7-4d4e-4ce1-8b37-ca7802057284 tempest-TestStampPattern-1149007075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba 1G" returned: 0 in 0.908s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3c4bf2f7-4d4e-4ce1-8b37-ca7802057284 tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45009935-e5be-45f1-afb7-af3dcd19075c -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:17 devstack sudo[112934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45009935-e5be-45f1-afb7-af3dcd19075c -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba Jun 30 16:28:17 devstack sudo[112934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:17 devstack sudo[112934]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3c4bf2f7-4d4e-4ce1-8b37-ca7802057284 tempest-TestStampPattern-1149007075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45009935-e5be-45f1-afb7-af3dcd19075c -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba" returned: 0 in 0.773s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:17 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-3c4bf2f7-4d4e-4ce1-8b37-ca7802057284 tempest-TestStampPattern-1149007075 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba is being set with open permissions: ugo+rw Jun 30 16:28:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3c4bf2f7-4d4e-4ce1-8b37-ca7802057284 tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:17 devstack sudo[112940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba Jun 30 16:28:17 devstack sudo[112940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:18 devstack sudo[112940]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3c4bf2f7-4d4e-4ce1-8b37-ca7802057284 tempest-TestStampPattern-1149007075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba" returned: 0 in 0.716s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3c4bf2f7-4d4e-4ce1-8b37-ca7802057284 tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:18 devstack sudo[112943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.info Jun 30 16:28:18 devstack sudo[112943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:19 devstack sudo[112943]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3c4bf2f7-4d4e-4ce1-8b37-ca7802057284 tempest-TestStampPattern-1149007075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.info" returned: 0 in 0.750s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:19 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-3c4bf2f7-4d4e-4ce1-8b37-ca7802057284 tempest-TestStampPattern-1149007075 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.info is being set with open permissions: ugo+rw Jun 30 16:28:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3c4bf2f7-4d4e-4ce1-8b37-ca7802057284 tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:19 devstack sudo[112946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.info Jun 30 16:28:19 devstack sudo[112946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:20 devstack sudo[112946]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3c4bf2f7-4d4e-4ce1-8b37-ca7802057284 tempest-TestStampPattern-1149007075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.info" returned: 0 in 0.641s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3c4bf2f7-4d4e-4ce1-8b37-ca7802057284 tempest-TestStampPattern-1149007075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.835s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:28:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.875s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:28:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Acquiring lock "cinder-quobyte-ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b-3e9d0f2e-df39-48db-a29f-ef837ffe6552" by "_create_volume_from_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:28:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Lock "cinder-quobyte-ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b-3e9d0f2e-df39-48db-a29f-ef837ffe6552" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:28:20 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Creating volume 3e9d0f2e-df39-48db-a29f-ef837ffe6552 from snapshot ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b {{(pid=93781) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 30 16:28:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:28:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:28:20 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:28:20 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:28:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:28:20 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:28:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Acquiring lock "cinder-quobyte-3e9d0f2e-df39-48db-a29f-ef837ffe6552" by "_copy_volume_from_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:28:20 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-3c4bf2f7-4d4e-4ce1-8b37-ca7802057284 tempest-TestStampPattern-1149007075 None] Create snapshot completed successfully Jun 30 16:28:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Lock "cinder-quobyte-3e9d0f2e-df39-48db-a29f-ef837ffe6552" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:28:20 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] snapshot: ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b, volume: 3e9d0f2e-df39-48db-a29f-ef837ffe6552, {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 30 16:28:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:28:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:28:20 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:28:20 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:28:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:28:20 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e17da29-ddc5-4d1a-9c22-a7e086157049]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:28:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:20 devstack sudo[112949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b Jun 30 16:28:20 devstack sudo[112949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:21 devstack sudo[112949]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b" returned: 0 in 0.931s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5827c57f-a2d5-430f-9018-010eff45677b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:28:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] will copy from snapshot at /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 30 16:28:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Creating direct copy from snapshot {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 30 16:28:21 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de8dd4e-ed8d-42f7-b014-1e6c6a4ba333]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:28:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:21 devstack sudo[112954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b Jun 30 16:28:21 devstack sudo[112954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:22 devstack sudo[112954]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b" returned: 0 in 0.957s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:22 devstack cinder-volume[93781]: DEBUG cinder.utils [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Path /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3e9d0f2e-df39-48db-a29f-ef837ffe6552 not found in is_blk_device check {{(pid=93781) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 30 16:28:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3e9d0f2e-df39-48db-a29f-ef837ffe6552 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:22 devstack sudo[112959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3e9d0f2e-df39-48db-a29f-ef837ffe6552 Jun 30 16:28:22 devstack sudo[112959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:27 devstack sudo[112959]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3e9d0f2e-df39-48db-a29f-ef837ffe6552" returned: 0 in 5.276s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:27 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f93a4c2-a4ee-4698-bea9-c22e98d11738]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:28:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:27 devstack sudo[113005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b Jun 30 16:28:27 devstack sudo[113005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:28 devstack sudo[113005]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b" returned: 0 in 1.018s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:28 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Image conversion details: src /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b, size 1024.00 MB, duration 5.28 sec, destination /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3e9d0f2e-df39-48db-a29f-ef837ffe6552 {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:28:28 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Converted 1024.00 MB image at 194.02 MB/s Jun 30 16:28:28 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3e9d0f2e-df39-48db-a29f-ef837ffe6552 is being set with open permissions: ugo+rw Jun 30 16:28:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3e9d0f2e-df39-48db-a29f-ef837ffe6552 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:28 devstack sudo[113018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3e9d0f2e-df39-48db-a29f-ef837ffe6552 Jun 30 16:28:28 devstack sudo[113018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:29 devstack sudo[113018]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3e9d0f2e-df39-48db-a29f-ef837ffe6552" returned: 0 in 0.835s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Lock "cinder-quobyte-3e9d0f2e-df39-48db-a29f-ef837ffe6552" released by "_copy_volume_from_snapshot" :: held 9.155s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:28:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Lock "cinder-quobyte-ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b-3e9d0f2e-df39-48db-a29f-ef837ffe6552" released by "_create_volume_from_snapshot" :: held 9.198s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:28:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.225s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:28:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9e5d1a-7f5a-482e-a7f9-5cfc3f1e482c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e9d0f2e-df39-48db-a29f-ef837ffe6552', 'volume_size': 1, 'snapshot_id': 'ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b'}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:28:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1320e81c-56e9-45e8-ba03-8d0f41bc605d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:28:29 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Volume volume-3e9d0f2e-df39-48db-a29f-ef837ffe6552 (3e9d0f2e-df39-48db-a29f-ef837ffe6552): created successfully Jun 30 16:28:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1320e81c-56e9-45e8-ba03-8d0f41bc605d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:28:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Flow 'volume_create_manager' (100cb5c9-a3a5-40fa-8855-156110cc3acc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:28:29 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-38c02448-5592-4f6a-b607-b3a90b9ad49b tempest-SnapshotDependencyTests-1906162278 None] Created volume successfully. Jun 30 16:28:30 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b7fb2580-98d5-4b3d-a751-2097a5247a1e tempest-SnapshotDependencyTests-1906162278 None] Acquiring lock "cinder-ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:28:30 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b7fb2580-98d5-4b3d-a751-2097a5247a1e tempest-SnapshotDependencyTests-1906162278 None] Lock "cinder-ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:28:30 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b7fb2580-98d5-4b3d-a751-2097a5247a1e tempest-SnapshotDependencyTests-1906162278 None] Acquiring lock "cinder-quobyte-5827c57f-a2d5-430f-9018-010eff45677b" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:28:30 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b7fb2580-98d5-4b3d-a751-2097a5247a1e tempest-SnapshotDependencyTests-1906162278 None] Lock "cinder-quobyte-5827c57f-a2d5-430f-9018-010eff45677b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:28:30 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b7fb2580-98d5-4b3d-a751-2097a5247a1e tempest-SnapshotDependencyTests-1906162278 None] Acquiring lock "cinder-quobyte-ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:28:30 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b7fb2580-98d5-4b3d-a751-2097a5247a1e tempest-SnapshotDependencyTests-1906162278 None] Lock "cinder-quobyte-ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:28:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-b7fb2580-98d5-4b3d-a751-2097a5247a1e tempest-SnapshotDependencyTests-1906162278 None] Deleting offline snapshot ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b of volume 5827c57f-a2d5-430f-9018-010eff45677b {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:28:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-b7fb2580-98d5-4b3d-a751-2097a5247a1e tempest-SnapshotDependencyTests-1906162278 None] snapshot_file for this snap is: volume-5827c57f-a2d5-430f-9018-010eff45677b.ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:28:30 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba96c8ff-ba01-46ae-a0d1-091e4a8da67d]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:28:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b7fb2580-98d5-4b3d-a751-2097a5247a1e tempest-SnapshotDependencyTests-1906162278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:30 devstack sudo[113021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b Jun 30 16:28:30 devstack sudo[113021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:31 devstack sudo[113021]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b7fb2580-98d5-4b3d-a751-2097a5247a1e tempest-SnapshotDependencyTests-1906162278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b" returned: 0 in 0.988s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-b7fb2580-98d5-4b3d-a751-2097a5247a1e tempest-SnapshotDependencyTests-1906162278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5827c57f-a2d5-430f-9018-010eff45677b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:28:31 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[450a2038-9a3a-42f8-a22a-f6e21d9ac546]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:28:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b7fb2580-98d5-4b3d-a751-2097a5247a1e tempest-SnapshotDependencyTests-1906162278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:31 devstack sudo[113026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b Jun 30 16:28:31 devstack sudo[113026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:32 devstack sudo[113026]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b7fb2580-98d5-4b3d-a751-2097a5247a1e tempest-SnapshotDependencyTests-1906162278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b" returned: 0 in 0.914s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b7fb2580-98d5-4b3d-a751-2097a5247a1e tempest-SnapshotDependencyTests-1906162278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:32 devstack sudo[113031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b Jun 30 16:28:32 devstack sudo[113031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Flow 'volume_create_manager' (931e51cd-83da-40eb-890a-f082ffbf71ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d34309-abbd-47ff-a46a-209e0f4d9d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d34309-abbd-47ff-a46a-209e0f4d9d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-569765330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be45ab45-4424-415a-b248-7a5f6b9bd332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fdc6ac6ace4bd29c8a0f7825ce3b74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:28:33Z,use_quota=True,user_id='1cb6b75edefe48dba18fb5b92d8c2b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:28:33 devstack sudo[113037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:28:33 devstack sudo[113037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3e6404-8e5c-4fa2-a19a-03791ad0c871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3e6404-8e5c-4fa2-a19a-03791ad0c871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f03777-ae7e-465a-b4fa-80ecc742ea5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f03777-ae7e-465a-b4fa-80ecc742ea5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'be45ab45-4424-415a-b248-7a5f6b9bd332', 'volume_name': 'volume-be45ab45-4424-415a-b248-7a5f6b9bd332', 'volume_size': 1, 'snapshot_id': 'aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba'}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41635d9f-d009-4a86-b6ac-77a4f5707b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41635d9f-d009-4a86-b6ac-77a4f5707b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c76ebe0-e68e-47fe-b1da-c2ce45571ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:28:33 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Volume be45ab45-4424-415a-b248-7a5f6b9bd332: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-be45ab45-4424-415a-b248-7a5f6b9bd332', 'volume_size': 1, 'snapshot_id': 'aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba'} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Acquiring lock "cinder-quobyte-aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba-be45ab45-4424-415a-b248-7a5f6b9bd332" by "_create_volume_from_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Lock "cinder-quobyte-aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba-be45ab45-4424-415a-b248-7a5f6b9bd332" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Creating volume be45ab45-4424-415a-b248-7a5f6b9bd332 from snapshot aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba {{(pid=93781) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Acquiring lock "cinder-quobyte-be45ab45-4424-415a-b248-7a5f6b9bd332" by "_copy_volume_from_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Lock "cinder-quobyte-be45ab45-4424-415a-b248-7a5f6b9bd332" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] snapshot: aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba, volume: be45ab45-4424-415a-b248-7a5f6b9bd332, {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5c15ac-be23-4177-9966-2389e105a816]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:33 devstack sudo[113031]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b7fb2580-98d5-4b3d-a751-2097a5247a1e tempest-SnapshotDependencyTests-1906162278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b" returned: 0 in 0.970s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b7fb2580-98d5-4b3d-a751-2097a5247a1e tempest-SnapshotDependencyTests-1906162278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:33 devstack sudo[113040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b Jun 30 16:28:33 devstack sudo[113040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:33 devstack sudo[113039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba Jun 30 16:28:33 devstack sudo[113039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:34 devstack sudo[113037]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.130s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:34 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:28:34 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:28:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 28 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:28:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:28:34 devstack sudo[113039]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba" returned: 0 in 0.944s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45009935-e5be-45f1-afb7-af3dcd19075c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:28:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] will copy from snapshot at /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 30 16:28:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Creating direct copy from snapshot {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 30 16:28:34 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f65aa74-eb29-45da-81a0-4c088337cd3c]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:28:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:34 devstack sudo[113051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c Jun 30 16:28:34 devstack sudo[113051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:34 devstack sudo[113040]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b7fb2580-98d5-4b3d-a751-2097a5247a1e tempest-SnapshotDependencyTests-1906162278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b.ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b" returned: 0 in 1.080s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:34 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b7fb2580-98d5-4b3d-a751-2097a5247a1e tempest-SnapshotDependencyTests-1906162278 None] Lock "cinder-quobyte-ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b" released by "_delete_snapshot" :: held 4.077s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:28:34 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b7fb2580-98d5-4b3d-a751-2097a5247a1e tempest-SnapshotDependencyTests-1906162278 None] Lock "cinder-quobyte-5827c57f-a2d5-430f-9018-010eff45677b" released by "delete_snapshot" :: held 4.109s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:28:34 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-b7fb2580-98d5-4b3d-a751-2097a5247a1e tempest-SnapshotDependencyTests-1906162278 None] Created reservations ['c3a61484-cb85-4f1f-a3cb-09838aa90b92', 'cba183cc-ca3a-47ba-ad8f-1a5f59e38799', 'd0a35098-27dc-4657-a48f-449531cabd69', 'a4cb38d3-eca3-4638-bbd3-16e39f1249ee'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:28:34 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-b7fb2580-98d5-4b3d-a751-2097a5247a1e tempest-SnapshotDependencyTests-1906162278 None] Delete snapshot completed successfully. Jun 30 16:28:34 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-b7fb2580-98d5-4b3d-a751-2097a5247a1e tempest-SnapshotDependencyTests-1906162278 None] Lock "cinder-ce0a70c3-0ff2-4f0e-b30f-6d2cf1378c4b-delete_snapshot" released by "delete_snapshot" :: held 4.353s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:28:35 devstack sudo[113051]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c" returned: 0 in 0.913s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:35 devstack cinder-volume[93781]: DEBUG cinder.utils [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Path /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-be45ab45-4424-415a-b248-7a5f6b9bd332 not found in is_blk_device check {{(pid=93781) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 30 16:28:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-be45ab45-4424-415a-b248-7a5f6b9bd332 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:35 devstack sudo[113057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-be45ab45-4424-415a-b248-7a5f6b9bd332 Jun 30 16:28:35 devstack sudo[113057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:35 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7a5112a5-d862-43b7-9fac-879177c2960f tempest-SnapshotDependencyTests-1906162278 None] Acquiring lock "cinder-5827c57f-a2d5-430f-9018-010eff45677b-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:28:35 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7a5112a5-d862-43b7-9fac-879177c2960f tempest-SnapshotDependencyTests-1906162278 None] Lock "cinder-5827c57f-a2d5-430f-9018-010eff45677b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:28:35 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7a5112a5-d862-43b7-9fac-879177c2960f tempest-SnapshotDependencyTests-1906162278 None] Acquiring lock "cinder-quobyte-5827c57f-a2d5-430f-9018-010eff45677b" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:28:35 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7a5112a5-d862-43b7-9fac-879177c2960f tempest-SnapshotDependencyTests-1906162278 None] Lock "cinder-quobyte-5827c57f-a2d5-430f-9018-010eff45677b" acquired by "delete_volume" :: waited 0.024s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:28:35 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef7438d-ab9a-40de-88b9-536ca9e8c10a]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:28:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7a5112a5-d862-43b7-9fac-879177c2960f tempest-SnapshotDependencyTests-1906162278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:36 devstack sudo[113062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b Jun 30 16:28:36 devstack sudo[113062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:37 devstack sudo[113062]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7a5112a5-d862-43b7-9fac-879177c2960f tempest-SnapshotDependencyTests-1906162278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b" returned: 0 in 1.733s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7a5112a5-d862-43b7-9fac-879177c2960f tempest-SnapshotDependencyTests-1906162278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:37 devstack sudo[113075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b Jun 30 16:28:37 devstack sudo[113075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:39 devstack sudo[113075]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7a5112a5-d862-43b7-9fac-879177c2960f tempest-SnapshotDependencyTests-1906162278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-5827c57f-a2d5-430f-9018-010eff45677b" returned: 0 in 1.516s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7a5112a5-d862-43b7-9fac-879177c2960f tempest-SnapshotDependencyTests-1906162278 None] Lock "cinder-quobyte-5827c57f-a2d5-430f-9018-010eff45677b" released by "delete_volume" :: held 3.373s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:28:39 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-7a5112a5-d862-43b7-9fac-879177c2960f tempest-SnapshotDependencyTests-1906162278 None] Created reservations ['0884bbfd-f4a7-4f17-8b5b-4072b8e2c582', 'e4d81fd0-6614-42ef-aea9-32a4cc6632c3', '7a2a4f17-a7e2-4875-82c8-550b578c011e', '7fe1901e-a815-4d61-8946-a02e5bb3b33f'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:28:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7a5112a5-d862-43b7-9fac-879177c2960f tempest-SnapshotDependencyTests-1906162278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:28:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7a5112a5-d862-43b7-9fac-879177c2960f tempest-SnapshotDependencyTests-1906162278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:28:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-7a5112a5-d862-43b7-9fac-879177c2960f tempest-SnapshotDependencyTests-1906162278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:28:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-7a5112a5-d862-43b7-9fac-879177c2960f tempest-SnapshotDependencyTests-1906162278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:28:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7a5112a5-d862-43b7-9fac-879177c2960f tempest-SnapshotDependencyTests-1906162278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:28:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7a5112a5-d862-43b7-9fac-879177c2960f tempest-SnapshotDependencyTests-1906162278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:39 devstack sudo[113078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:28:39 devstack sudo[113078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:40 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-263d2ef4-d915-417d-8464-9fe202ff52c9 tempest-SnapshotDependencyTests-1906162278 None] Acquiring lock "cinder-3e9d0f2e-df39-48db-a29f-ef837ffe6552-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:28:41 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-263d2ef4-d915-417d-8464-9fe202ff52c9 tempest-SnapshotDependencyTests-1906162278 None] Lock "cinder-3e9d0f2e-df39-48db-a29f-ef837ffe6552-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:28:41 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-263d2ef4-d915-417d-8464-9fe202ff52c9 tempest-SnapshotDependencyTests-1906162278 None] Acquiring lock "cinder-quobyte-3e9d0f2e-df39-48db-a29f-ef837ffe6552" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:28:41 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-263d2ef4-d915-417d-8464-9fe202ff52c9 tempest-SnapshotDependencyTests-1906162278 None] Lock "cinder-quobyte-3e9d0f2e-df39-48db-a29f-ef837ffe6552" acquired by "delete_volume" :: waited 0.069s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:28:41 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19ba075-6b19-4ee5-9bd7-2ae4ccf17bae]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:28:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-263d2ef4-d915-417d-8464-9fe202ff52c9 tempest-SnapshotDependencyTests-1906162278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3e9d0f2e-df39-48db-a29f-ef837ffe6552 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:41 devstack sudo[113082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3e9d0f2e-df39-48db-a29f-ef837ffe6552 Jun 30 16:28:41 devstack sudo[113082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:42 devstack sudo[113078]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7a5112a5-d862-43b7-9fac-879177c2960f tempest-SnapshotDependencyTests-1906162278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 2.303s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:42 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-7a5112a5-d862-43b7-9fac-879177c2960f tempest-SnapshotDependencyTests-1906162278 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:28:42 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-7a5112a5-d862-43b7-9fac-879177c2960f tempest-SnapshotDependencyTests-1906162278 None] Deleted volume successfully. Jun 30 16:28:42 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7a5112a5-d862-43b7-9fac-879177c2960f tempest-SnapshotDependencyTests-1906162278 None] Lock "cinder-5827c57f-a2d5-430f-9018-010eff45677b-delete_volume" released by "delete_volume" :: held 6.287s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:28:42 devstack sudo[113057]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-be45ab45-4424-415a-b248-7a5f6b9bd332" returned: 0 in 7.456s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:42 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[9204f8bf-aada-438e-bb9d-4ce78f913897]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:28:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:42 devstack sudo[113085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c Jun 30 16:28:42 devstack sudo[113085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:43 devstack sudo[113082]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-263d2ef4-d915-417d-8464-9fe202ff52c9 tempest-SnapshotDependencyTests-1906162278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3e9d0f2e-df39-48db-a29f-ef837ffe6552" returned: 0 in 1.767s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-263d2ef4-d915-417d-8464-9fe202ff52c9 tempest-SnapshotDependencyTests-1906162278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3e9d0f2e-df39-48db-a29f-ef837ffe6552 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:43 devstack sudo[113090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3e9d0f2e-df39-48db-a29f-ef837ffe6552 Jun 30 16:28:43 devstack sudo[113090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:44 devstack sudo[113085]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c" returned: 0 in 1.405s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:44 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Image conversion details: src /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c, size 1024.00 MB, duration 7.46 sec, destination /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-be45ab45-4424-415a-b248-7a5f6b9bd332 {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:28:44 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Converted 1024.00 MB image at 137.32 MB/s Jun 30 16:28:44 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-be45ab45-4424-415a-b248-7a5f6b9bd332 is being set with open permissions: ugo+rw Jun 30 16:28:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-be45ab45-4424-415a-b248-7a5f6b9bd332 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:44 devstack sudo[113090]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-263d2ef4-d915-417d-8464-9fe202ff52c9 tempest-SnapshotDependencyTests-1906162278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3e9d0f2e-df39-48db-a29f-ef837ffe6552" returned: 0 in 1.032s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:44 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-263d2ef4-d915-417d-8464-9fe202ff52c9 tempest-SnapshotDependencyTests-1906162278 None] Lock "cinder-quobyte-3e9d0f2e-df39-48db-a29f-ef837ffe6552" released by "delete_volume" :: held 2.965s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:28:44 devstack sudo[113104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-be45ab45-4424-415a-b248-7a5f6b9bd332 Jun 30 16:28:44 devstack sudo[113104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:44 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-263d2ef4-d915-417d-8464-9fe202ff52c9 tempest-SnapshotDependencyTests-1906162278 None] Created reservations ['9902630b-1847-4a99-98ee-ac0f86dc3e00', '29eb2e19-1721-46d9-900d-a84edda35bb5', '4c310c22-c880-4b1b-93d0-5a38ec2bb2db', '1c4f7bd9-7176-45db-8ee3-72184cd533ab'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:28:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-263d2ef4-d915-417d-8464-9fe202ff52c9 tempest-SnapshotDependencyTests-1906162278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:28:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-263d2ef4-d915-417d-8464-9fe202ff52c9 tempest-SnapshotDependencyTests-1906162278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:28:44 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-263d2ef4-d915-417d-8464-9fe202ff52c9 tempest-SnapshotDependencyTests-1906162278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:28:44 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-263d2ef4-d915-417d-8464-9fe202ff52c9 tempest-SnapshotDependencyTests-1906162278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:28:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-263d2ef4-d915-417d-8464-9fe202ff52c9 tempest-SnapshotDependencyTests-1906162278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:28:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-263d2ef4-d915-417d-8464-9fe202ff52c9 tempest-SnapshotDependencyTests-1906162278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:28:44 devstack sudo[113107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:28:44 devstack sudo[113107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:28:45 devstack sudo[113104]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-be45ab45-4424-415a-b248-7a5f6b9bd332" returned: 0 in 1.129s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Lock "cinder-quobyte-be45ab45-4424-415a-b248-7a5f6b9bd332" released by "_copy_volume_from_snapshot" :: held 12.021s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:28:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Lock "cinder-quobyte-aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba-be45ab45-4424-415a-b248-7a5f6b9bd332" released by "_create_volume_from_snapshot" :: held 12.073s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:28:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.092s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:28:45 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c76ebe0-e68e-47fe-b1da-c2ce45571ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be45ab45-4424-415a-b248-7a5f6b9bd332', 'volume_size': 1, 'snapshot_id': 'aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba'}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:28:45 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdba0f15-7659-4b96-8f71-e49f097a9c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:28:45 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Volume volume-be45ab45-4424-415a-b248-7a5f6b9bd332 (be45ab45-4424-415a-b248-7a5f6b9bd332): created successfully Jun 30 16:28:45 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdba0f15-7659-4b96-8f71-e49f097a9c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:28:45 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Flow 'volume_create_manager' (931e51cd-83da-40eb-890a-f082ffbf71ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:28:45 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-9e9e34b0-3049-4fbc-bc13-a155470130f8 tempest-TestStampPattern-1149007075 None] Created volume successfully. Jun 30 16:28:45 devstack sudo[113107]: pam_unix(sudo:session): session closed for user root Jun 30 16:28:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-263d2ef4-d915-417d-8464-9fe202ff52c9 tempest-SnapshotDependencyTests-1906162278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.095s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:28:45 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-263d2ef4-d915-417d-8464-9fe202ff52c9 tempest-SnapshotDependencyTests-1906162278 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:28:45 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-263d2ef4-d915-417d-8464-9fe202ff52c9 tempest-SnapshotDependencyTests-1906162278 None] Deleted volume successfully. Jun 30 16:28:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-263d2ef4-d915-417d-8464-9fe202ff52c9 tempest-SnapshotDependencyTests-1906162278 None] Lock "cinder-3e9d0f2e-df39-48db-a29f-ef837ffe6552-delete_volume" released by "delete_volume" :: held 4.558s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:28:55 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=42,cinder:UPDATE=32,cinder:INSERT=9,cinder:DELETE=3 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:28:55 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=31,cinder:UPDATE=35,cinder:DELETE=4,cinder:INSERT=6 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:29:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:29:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:29:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:29:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:29:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:29:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:29:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:29:33 devstack sudo[113267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:29:33 devstack sudo[113267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:29:33 devstack sudo[113267]: pam_unix(sudo:session): session closed for user root Jun 30 16:29:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.755s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:29:33 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:29:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:29:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 28 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:29:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:29:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-2caa22e0-214a-49c4-8348-7784365f1fbf req-0addd4fe-a21a-49ea-825c-1eca7a0fbb06 tempest-TestStampPattern-1149007075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:29:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-2caa22e0-214a-49c4-8348-7784365f1fbf req-0addd4fe-a21a-49ea-825c-1eca7a0fbb06 tempest-TestStampPattern-1149007075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:29:37 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c880e44-1cd9-4961-98fe-95aede0c0148]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:29:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-2caa22e0-214a-49c4-8348-7784365f1fbf req-0addd4fe-a21a-49ea-825c-1eca7a0fbb06 tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-be45ab45-4424-415a-b248-7a5f6b9bd332 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:29:37 devstack sudo[113286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-be45ab45-4424-415a-b248-7a5f6b9bd332 Jun 30 16:29:37 devstack sudo[113286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:29:38 devstack sudo[113286]: pam_unix(sudo:session): session closed for user root Jun 30 16:29:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [req-2caa22e0-214a-49c4-8348-7784365f1fbf req-0addd4fe-a21a-49ea-825c-1eca7a0fbb06 tempest-TestStampPattern-1149007075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-be45ab45-4424-415a-b248-7a5f6b9bd332" returned: 0 in 0.902s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:29:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [req-2caa22e0-214a-49c4-8348-7784365f1fbf req-0addd4fe-a21a-49ea-825c-1eca7a0fbb06 tempest-TestStampPattern-1149007075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.923s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:29:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-2caa22e0-214a-49c4-8348-7784365f1fbf req-0addd4fe-a21a-49ea-825c-1eca7a0fbb06 tempest-TestStampPattern-1149007075 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a', 'name': 'volume-be45ab45-4424-415a-b248-7a5f6b9bd332', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0890e77a-997e-4acb-a43e-03df1b5344b8', 'enforce_multipath': True} {{(pid=93781) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 30 16:29:38 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-2caa22e0-214a-49c4-8348-7784365f1fbf req-0addd4fe-a21a-49ea-825c-1eca7a0fbb06 tempest-TestStampPattern-1149007075 None] attachment_update completed successfully. Jun 30 16:29:46 devstack cinder-volume[93781]: INFO cinder.volume.manager [req-b90ade95-83e8-4711-a7df-855ef0d5e144 req-70efa2b3-03a5-4ecc-9d82-d9dbfd728c60 tempest-TestStampPattern-1149007075 None] Terminate volume connection completed successfully. Jun 30 16:29:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [req-b90ade95-83e8-4711-a7df-855ef0d5e144 req-70efa2b3-03a5-4ecc-9d82-d9dbfd728c60 tempest-TestStampPattern-1149007075 None] Deleting attachment 0890e77a-997e-4acb-a43e-03df1b5344b8. {{(pid=93781) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 30 16:29:56 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:29:56 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=7 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:29:58 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a46c1341-03ec-40a8-b61b-8934c5d68b93 tempest-TestStampPattern-1149007075 None] Acquiring lock "cinder-be45ab45-4424-415a-b248-7a5f6b9bd332-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:29:58 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a46c1341-03ec-40a8-b61b-8934c5d68b93 tempest-TestStampPattern-1149007075 None] Lock "cinder-be45ab45-4424-415a-b248-7a5f6b9bd332-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:29:58 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a46c1341-03ec-40a8-b61b-8934c5d68b93 tempest-TestStampPattern-1149007075 None] Acquiring lock "cinder-quobyte-be45ab45-4424-415a-b248-7a5f6b9bd332" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:29:58 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a46c1341-03ec-40a8-b61b-8934c5d68b93 tempest-TestStampPattern-1149007075 None] Lock "cinder-quobyte-be45ab45-4424-415a-b248-7a5f6b9bd332" acquired by "delete_volume" :: waited 0.021s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:29:58 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[806ba017-c4bc-42cd-82e8-23bf90a99ed0]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:29:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a46c1341-03ec-40a8-b61b-8934c5d68b93 tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-be45ab45-4424-415a-b248-7a5f6b9bd332 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:29:58 devstack sudo[113784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-be45ab45-4424-415a-b248-7a5f6b9bd332 Jun 30 16:29:58 devstack sudo[113784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:29:59 devstack sudo[113784]: pam_unix(sudo:session): session closed for user root Jun 30 16:29:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a46c1341-03ec-40a8-b61b-8934c5d68b93 tempest-TestStampPattern-1149007075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-be45ab45-4424-415a-b248-7a5f6b9bd332" returned: 0 in 0.845s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:29:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a46c1341-03ec-40a8-b61b-8934c5d68b93 tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-be45ab45-4424-415a-b248-7a5f6b9bd332 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:29:59 devstack sudo[113789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-be45ab45-4424-415a-b248-7a5f6b9bd332 Jun 30 16:29:59 devstack sudo[113789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:00 devstack sudo[113789]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a46c1341-03ec-40a8-b61b-8934c5d68b93 tempest-TestStampPattern-1149007075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-be45ab45-4424-415a-b248-7a5f6b9bd332" returned: 0 in 0.857s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a46c1341-03ec-40a8-b61b-8934c5d68b93 tempest-TestStampPattern-1149007075 None] Lock "cinder-quobyte-be45ab45-4424-415a-b248-7a5f6b9bd332" released by "delete_volume" :: held 1.753s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:30:00 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-a46c1341-03ec-40a8-b61b-8934c5d68b93 tempest-TestStampPattern-1149007075 None] Created reservations ['1d2d38ac-6fee-43a1-9e6f-9bf51e1d552e', 'eef3133e-973f-4dbf-a966-1d5ddaa67c8e', '845994f2-97b8-48ec-bfd5-d86c1bd1a959', '05cefe94-554c-4e9c-85c3-f85db240b4ff'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:30:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a46c1341-03ec-40a8-b61b-8934c5d68b93 tempest-TestStampPattern-1149007075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:30:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a46c1341-03ec-40a8-b61b-8934c5d68b93 tempest-TestStampPattern-1149007075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:30:00 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a46c1341-03ec-40a8-b61b-8934c5d68b93 tempest-TestStampPattern-1149007075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:30:00 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a46c1341-03ec-40a8-b61b-8934c5d68b93 tempest-TestStampPattern-1149007075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:30:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a46c1341-03ec-40a8-b61b-8934c5d68b93 tempest-TestStampPattern-1149007075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:30:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a46c1341-03ec-40a8-b61b-8934c5d68b93 tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:00 devstack sudo[113792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:30:00 devstack sudo[113792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-dec2e4b3-c789-4a33-9032-b3758a7518ea tempest-TestStampPattern-1149007075 None] Acquiring lock "cinder-aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:30:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-dec2e4b3-c789-4a33-9032-b3758a7518ea tempest-TestStampPattern-1149007075 None] Lock "cinder-aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:30:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-dec2e4b3-c789-4a33-9032-b3758a7518ea tempest-TestStampPattern-1149007075 None] Acquiring lock "cinder-quobyte-45009935-e5be-45f1-afb7-af3dcd19075c" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:30:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-dec2e4b3-c789-4a33-9032-b3758a7518ea tempest-TestStampPattern-1149007075 None] Lock "cinder-quobyte-45009935-e5be-45f1-afb7-af3dcd19075c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:30:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-dec2e4b3-c789-4a33-9032-b3758a7518ea tempest-TestStampPattern-1149007075 None] Acquiring lock "cinder-quobyte-aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:30:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-dec2e4b3-c789-4a33-9032-b3758a7518ea tempest-TestStampPattern-1149007075 None] Lock "cinder-quobyte-aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:30:00 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-dec2e4b3-c789-4a33-9032-b3758a7518ea tempest-TestStampPattern-1149007075 None] Deleting offline snapshot aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba of volume 45009935-e5be-45f1-afb7-af3dcd19075c {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:30:00 devstack sudo[113792]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:00 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-dec2e4b3-c789-4a33-9032-b3758a7518ea tempest-TestStampPattern-1149007075 None] snapshot_file for this snap is: volume-45009935-e5be-45f1-afb7-af3dcd19075c.aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:30:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a46c1341-03ec-40a8-b61b-8934c5d68b93 tempest-TestStampPattern-1149007075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.769s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:00 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a46c1341-03ec-40a8-b61b-8934c5d68b93 tempest-TestStampPattern-1149007075 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:30:00 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-a46c1341-03ec-40a8-b61b-8934c5d68b93 tempest-TestStampPattern-1149007075 None] Deleted volume successfully. Jun 30 16:30:00 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddcce56-4514-4635-be10-7584b636e76e]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:30:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-dec2e4b3-c789-4a33-9032-b3758a7518ea tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a46c1341-03ec-40a8-b61b-8934c5d68b93 tempest-TestStampPattern-1149007075 None] Lock "cinder-be45ab45-4424-415a-b248-7a5f6b9bd332-delete_volume" released by "delete_volume" :: held 2.791s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:30:01 devstack sudo[113795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba Jun 30 16:30:01 devstack sudo[113795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:01 devstack sudo[113795]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-dec2e4b3-c789-4a33-9032-b3758a7518ea tempest-TestStampPattern-1149007075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba" returned: 0 in 0.812s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:01 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-dec2e4b3-c789-4a33-9032-b3758a7518ea tempest-TestStampPattern-1149007075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45009935-e5be-45f1-afb7-af3dcd19075c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:30:01 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd94d51f-8963-4a2c-9de7-856b50660168]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:30:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-dec2e4b3-c789-4a33-9032-b3758a7518ea tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:01 devstack sudo[113800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c Jun 30 16:30:01 devstack sudo[113800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:02 devstack sudo[113800]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-dec2e4b3-c789-4a33-9032-b3758a7518ea tempest-TestStampPattern-1149007075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c" returned: 0 in 0.862s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-dec2e4b3-c789-4a33-9032-b3758a7518ea tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:02 devstack sudo[113805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba Jun 30 16:30:02 devstack sudo[113805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:03 devstack sudo[113805]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-dec2e4b3-c789-4a33-9032-b3758a7518ea tempest-TestStampPattern-1149007075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba" returned: 0 in 0.780s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-dec2e4b3-c789-4a33-9032-b3758a7518ea tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:03 devstack sudo[113810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba Jun 30 16:30:03 devstack sudo[113810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:04 devstack sudo[113810]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-dec2e4b3-c789-4a33-9032-b3758a7518ea tempest-TestStampPattern-1149007075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c.aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba" returned: 0 in 0.807s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-dec2e4b3-c789-4a33-9032-b3758a7518ea tempest-TestStampPattern-1149007075 None] Lock "cinder-quobyte-aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba" released by "_delete_snapshot" :: held 3.388s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:30:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-dec2e4b3-c789-4a33-9032-b3758a7518ea tempest-TestStampPattern-1149007075 None] Lock "cinder-quobyte-45009935-e5be-45f1-afb7-af3dcd19075c" released by "delete_snapshot" :: held 3.415s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:30:04 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-dec2e4b3-c789-4a33-9032-b3758a7518ea tempest-TestStampPattern-1149007075 None] Created reservations ['f4ba5564-b5c1-4dd5-90a1-702800871e20', '5d637c14-7155-4f8d-b152-152be39e77f2', '033d65a1-758b-4c9e-9c12-46327c555c6a', '00500604-0c2d-455c-ac04-2f36a3b71927'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:30:04 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-dec2e4b3-c789-4a33-9032-b3758a7518ea tempest-TestStampPattern-1149007075 None] Delete snapshot completed successfully. Jun 30 16:30:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-dec2e4b3-c789-4a33-9032-b3758a7518ea tempest-TestStampPattern-1149007075 None] Lock "cinder-aad6d4b2-92ba-47ec-a9b0-d94c76d0c8ba-delete_snapshot" released by "delete_snapshot" :: held 3.555s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:30:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e201e61e-241b-454a-b80d-2f716b15a23f tempest-TestStampPattern-1149007075 None] Acquiring lock "cinder-45009935-e5be-45f1-afb7-af3dcd19075c-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:30:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e201e61e-241b-454a-b80d-2f716b15a23f tempest-TestStampPattern-1149007075 None] Lock "cinder-45009935-e5be-45f1-afb7-af3dcd19075c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:30:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e201e61e-241b-454a-b80d-2f716b15a23f tempest-TestStampPattern-1149007075 None] Acquiring lock "cinder-quobyte-45009935-e5be-45f1-afb7-af3dcd19075c" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:30:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e201e61e-241b-454a-b80d-2f716b15a23f tempest-TestStampPattern-1149007075 None] Lock "cinder-quobyte-45009935-e5be-45f1-afb7-af3dcd19075c" acquired by "delete_volume" :: waited 0.024s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:30:12 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a958c1-36f5-4c69-8fa2-22b77e9bafa6]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:30:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e201e61e-241b-454a-b80d-2f716b15a23f tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:12 devstack sudo[113902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c Jun 30 16:30:12 devstack sudo[113902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:13 devstack sudo[113902]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e201e61e-241b-454a-b80d-2f716b15a23f tempest-TestStampPattern-1149007075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c" returned: 0 in 0.836s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e201e61e-241b-454a-b80d-2f716b15a23f tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:13 devstack sudo[113907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c Jun 30 16:30:13 devstack sudo[113907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:14 devstack sudo[113907]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e201e61e-241b-454a-b80d-2f716b15a23f tempest-TestStampPattern-1149007075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-45009935-e5be-45f1-afb7-af3dcd19075c" returned: 0 in 0.734s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:14 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e201e61e-241b-454a-b80d-2f716b15a23f tempest-TestStampPattern-1149007075 None] Lock "cinder-quobyte-45009935-e5be-45f1-afb7-af3dcd19075c" released by "delete_volume" :: held 1.641s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:30:14 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-e201e61e-241b-454a-b80d-2f716b15a23f tempest-TestStampPattern-1149007075 None] Created reservations ['b0182e90-6414-4d35-bda8-3d9dc5cc2af2', '4d43a0f3-5e5f-4d03-87ad-06bd43cc7bef', '2714da13-4cb1-4794-a0b8-9851b2ee185a', '3c0ce3cf-162d-44a4-a353-cbada0b359c9'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:30:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e201e61e-241b-454a-b80d-2f716b15a23f tempest-TestStampPattern-1149007075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:30:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e201e61e-241b-454a-b80d-2f716b15a23f tempest-TestStampPattern-1149007075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:30:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e201e61e-241b-454a-b80d-2f716b15a23f tempest-TestStampPattern-1149007075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:30:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-e201e61e-241b-454a-b80d-2f716b15a23f tempest-TestStampPattern-1149007075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:30:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-e201e61e-241b-454a-b80d-2f716b15a23f tempest-TestStampPattern-1149007075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:30:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e201e61e-241b-454a-b80d-2f716b15a23f tempest-TestStampPattern-1149007075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:14 devstack sudo[113910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:30:14 devstack sudo[113910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:15 devstack sudo[113910]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e201e61e-241b-454a-b80d-2f716b15a23f tempest-TestStampPattern-1149007075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.705s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:15 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-e201e61e-241b-454a-b80d-2f716b15a23f tempest-TestStampPattern-1149007075 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:30:15 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-e201e61e-241b-454a-b80d-2f716b15a23f tempest-TestStampPattern-1149007075 None] Deleted volume successfully. Jun 30 16:30:15 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e201e61e-241b-454a-b80d-2f716b15a23f tempest-TestStampPattern-1149007075 None] Lock "cinder-45009935-e5be-45f1-afb7-af3dcd19075c-delete_volume" released by "delete_volume" :: held 2.618s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:30:24 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=15,cinder:INSERT=6,cinder:UPDATE=21 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:30:25 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=16,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=2 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:30:27 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:30:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Flow 'volume_create_manager' (0d6f259f-474f-443a-a537-b56f97a0337f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:30:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d5d90e-9343-44a7-aea8-90504621e50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d5d90e-9343-44a7-aea8-90504621e50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1408133829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed65316-5707-4bcd-963d-127d421d8241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86abf563f8af4778972e6fca2252d316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:30:28Z,use_quota=True,user_id='c2683d16b2f4406a8c518a55fa284f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22612c94-7879-40fc-979a-65bc73f9967c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22612c94-7879-40fc-979a-65bc73f9967c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e66422-ad30-4cef-a5c2-04f31a5a14db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e66422-ad30-4cef-a5c2-04f31a5a14db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ed65316-5707-4bcd-963d-127d421d8241', 'volume_name': 'volume-3ed65316-5707-4bcd-963d-127d421d8241', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b79a613-50ab-4bdc-b58d-f664292924c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b79a613-50ab-4bdc-b58d-f664292924c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:27 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573c636a-4885-47f8-88c5-366791f75c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:27 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Volume 3ed65316-5707-4bcd-963d-127d421d8241: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ed65316-5707-4bcd-963d-127d421d8241', 'volume_size': 1} Jun 30 16:30:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:30:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:30:27 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1408133829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed65316-5707-4bcd-963d-127d421d8241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86abf563f8af4778972e6fca2252d316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:30:28Z,use_quota=True,user_id='c2683d16b2f4406a8c518a55fa284f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:30:27 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Creating volume 3ed65316-5707-4bcd-963d-127d421d8241 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:30:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:30:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:30:27 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:30:27 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:30:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:30:27 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:30:27 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:30:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:28 devstack sudo[113919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241 1073741824 Jun 30 16:30:28 devstack sudo[113919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:28 devstack sudo[113919]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241 1073741824" returned: 0 in 0.922s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:28 devstack sudo[113925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241 Jun 30 16:30:28 devstack sudo[113925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:29 devstack sudo[113925]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241" returned: 0 in 0.696s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:30:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:30:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573c636a-4885-47f8-88c5-366791f75c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ed65316-5707-4bcd-963d-127d421d8241', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394df2f8-6f7d-42ed-a582-44355bc6a0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:29 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Volume volume-3ed65316-5707-4bcd-963d-127d421d8241 (3ed65316-5707-4bcd-963d-127d421d8241): created successfully Jun 30 16:30:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394df2f8-6f7d-42ed-a582-44355bc6a0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Flow 'volume_create_manager' (0d6f259f-474f-443a-a537-b56f97a0337f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:30:29 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-afa7f5fe-603d-4454-9877-787db07cd9bc tempest-CreateVolumesFromSnapshotTest-205532439 None] Created volume successfully. Jun 30 16:30:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5407f3bb-e5ce-4937-87dc-fd8635ca01a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:30:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5407f3bb-e5ce-4937-87dc-fd8635ca01a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:30:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-5407f3bb-e5ce-4937-87dc-fd8635ca01a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Creating offline snapshot 5a0d5283-68cd-454f-8f33-c0b210ea5ab4 of volume 3ed65316-5707-4bcd-963d-127d421d8241 {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:30:30 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[4749043d-f3e3-4e0a-933f-c8da2e0d59a2]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:30:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5407f3bb-e5ce-4937-87dc-fd8635ca01a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:30 devstack sudo[113928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241 Jun 30 16:30:30 devstack sudo[113928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:31 devstack sudo[113928]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5407f3bb-e5ce-4937-87dc-fd8635ca01a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241" returned: 0 in 0.914s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5407f3bb-e5ce-4937-87dc-fd8635ca01a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.5a0d5283-68cd-454f-8f33-c0b210ea5ab4 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:31 devstack sudo[113933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.5a0d5283-68cd-454f-8f33-c0b210ea5ab4 1G Jun 30 16:30:31 devstack sudo[113933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:32 devstack sudo[113933]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5407f3bb-e5ce-4937-87dc-fd8635ca01a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.5a0d5283-68cd-454f-8f33-c0b210ea5ab4 1G" returned: 0 in 0.961s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5407f3bb-e5ce-4937-87dc-fd8635ca01a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ed65316-5707-4bcd-963d-127d421d8241 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.5a0d5283-68cd-454f-8f33-c0b210ea5ab4 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:32 devstack sudo[113938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ed65316-5707-4bcd-963d-127d421d8241 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.5a0d5283-68cd-454f-8f33-c0b210ea5ab4 Jun 30 16:30:32 devstack sudo[113938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:32 devstack sudo[113938]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5407f3bb-e5ce-4937-87dc-fd8635ca01a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ed65316-5707-4bcd-963d-127d421d8241 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.5a0d5283-68cd-454f-8f33-c0b210ea5ab4" returned: 0 in 0.770s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:32 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-5407f3bb-e5ce-4937-87dc-fd8635ca01a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.5a0d5283-68cd-454f-8f33-c0b210ea5ab4 is being set with open permissions: ugo+rw Jun 30 16:30:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5407f3bb-e5ce-4937-87dc-fd8635ca01a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.5a0d5283-68cd-454f-8f33-c0b210ea5ab4 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:32 devstack sudo[113943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.5a0d5283-68cd-454f-8f33-c0b210ea5ab4 Jun 30 16:30:32 devstack sudo[113943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:30:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:30:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:30:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:30:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:30:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:30:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:33 devstack sudo[113945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:30:33 devstack sudo[113945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:33 devstack sudo[113943]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5407f3bb-e5ce-4937-87dc-fd8635ca01a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.5a0d5283-68cd-454f-8f33-c0b210ea5ab4" returned: 0 in 0.804s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5407f3bb-e5ce-4937-87dc-fd8635ca01a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:33 devstack sudo[113949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.info Jun 30 16:30:33 devstack sudo[113949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:33 devstack sudo[113945]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.731s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:33 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:30:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:30:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 28 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:30:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:30:34 devstack sudo[113949]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5407f3bb-e5ce-4937-87dc-fd8635ca01a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.info" returned: 0 in 0.736s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:34 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-5407f3bb-e5ce-4937-87dc-fd8635ca01a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.info is being set with open permissions: ugo+rw Jun 30 16:30:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5407f3bb-e5ce-4937-87dc-fd8635ca01a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:34 devstack sudo[113952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.info Jun 30 16:30:34 devstack sudo[113952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:35 devstack sudo[113952]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5407f3bb-e5ce-4937-87dc-fd8635ca01a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.info" returned: 0 in 0.814s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5407f3bb-e5ce-4937-87dc-fd8635ca01a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.127s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:30:35 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-5407f3bb-e5ce-4937-87dc-fd8635ca01a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Create snapshot completed successfully Jun 30 16:30:35 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Flow 'volume_create_manager' (94c733b4-1d7d-40d5-9412-7afeba4cb5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bddbd449-c247-4c4a-bdf2-c2ca818efe2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bddbd449-c247-4c4a-bdf2-c2ca818efe2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1652348875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=673f30b7-11d0-4d6c-9316-2b56cdd3df12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86abf563f8af4778972e6fca2252d316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:30:36Z,use_quota=True,user_id='c2683d16b2f4406a8c518a55fa284f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a668ab79-247a-45bf-9217-b67e5bcc69bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a668ab79-247a-45bf-9217-b67e5bcc69bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450bab8a-ad90-48ba-89d6-a932c30543d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450bab8a-ad90-48ba-89d6-a932c30543d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '673f30b7-11d0-4d6c-9316-2b56cdd3df12', 'volume_name': 'volume-673f30b7-11d0-4d6c-9316-2b56cdd3df12', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b01b984-3255-4500-b5ed-c716810c7c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b01b984-3255-4500-b5ed-c716810c7c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c04cee6-0c5f-492d-816f-a4ea4a1b3a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:36 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Volume 673f30b7-11d0-4d6c-9316-2b56cdd3df12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-673f30b7-11d0-4d6c-9316-2b56cdd3df12', 'volume_size': 1} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1652348875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=673f30b7-11d0-4d6c-9316-2b56cdd3df12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86abf563f8af4778972e6fca2252d316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:30:36Z,use_quota=True,user_id='c2683d16b2f4406a8c518a55fa284f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Creating volume 673f30b7-11d0-4d6c-9316-2b56cdd3df12 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:30:36 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-673f30b7-11d0-4d6c-9316-2b56cdd3df12 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:36 devstack sudo[113955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-673f30b7-11d0-4d6c-9316-2b56cdd3df12 1073741824 Jun 30 16:30:36 devstack sudo[113955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Flow 'volume_create_manager' (99dd2a13-063b-4af3-ac21-7eeaad349c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05401151-822e-4df7-b5a0-250005cb4b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05401151-822e-4df7-b5a0-250005cb4b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1584847493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bb877a7-807e-4a3a-adef-4ba7641d2389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86abf563f8af4778972e6fca2252d316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:30:36Z,use_quota=True,user_id='c2683d16b2f4406a8c518a55fa284f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58055331-f25c-4aca-abc7-9e60c2f43c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58055331-f25c-4aca-abc7-9e60c2f43c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2a8cb2-d8fd-4d7b-bf5d-8b19f59dd4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2a8cb2-d8fd-4d7b-bf5d-8b19f59dd4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bb877a7-807e-4a3a-adef-4ba7641d2389', 'volume_name': 'volume-2bb877a7-807e-4a3a-adef-4ba7641d2389', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bad3d30-4c18-45cd-bef3-ca3bce76a941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bad3d30-4c18-45cd-bef3-ca3bce76a941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24dee1d8-9da9-40c5-8993-2cd70382edf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:36 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Volume 2bb877a7-807e-4a3a-adef-4ba7641d2389: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bb877a7-807e-4a3a-adef-4ba7641d2389', 'volume_size': 1} Jun 30 16:30:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Flow 'volume_create_manager' (73763cb4-c88b-468a-9371-bd4bc6a1268b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bfdb98-7014-4635-910b-e9d881cca3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bfdb98-7014-4635-910b-e9d881cca3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1550107429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f97240-edf0-4c35-93ae-f6a00bb3a7bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86abf563f8af4778972e6fca2252d316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:30:37Z,use_quota=True,user_id='c2683d16b2f4406a8c518a55fa284f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e364a60-8ca8-45d4-8b67-b8612bef9cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e364a60-8ca8-45d4-8b67-b8612bef9cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc06171-c300-4998-b220-d54c7b57eb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc06171-c300-4998-b220-d54c7b57eb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29f97240-edf0-4c35-93ae-f6a00bb3a7bc', 'volume_name': 'volume-29f97240-edf0-4c35-93ae-f6a00bb3a7bc', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e517eb2-5f1a-4529-8fa3-558b354d2344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e517eb2-5f1a-4529-8fa3-558b354d2344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a9f55f-17fc-4d04-a156-0d96ff8d81c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:37 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Volume 29f97240-edf0-4c35-93ae-f6a00bb3a7bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29f97240-edf0-4c35-93ae-f6a00bb3a7bc', 'volume_size': 1} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:30:37 devstack sudo[113955]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-673f30b7-11d0-4d6c-9316-2b56cdd3df12 1073741824" returned: 0 in 1.045s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-673f30b7-11d0-4d6c-9316-2b56cdd3df12 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:37 devstack sudo[113962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-673f30b7-11d0-4d6c-9316-2b56cdd3df12 Jun 30 16:30:37 devstack sudo[113962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Flow 'volume_create_manager' (78e01e8d-8b11-4a6c-954b-5828df7fa2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d36bea2-1646-4019-a641-d8d50f7fcf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d36bea2-1646-4019-a641-d8d50f7fcf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1854958596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17be28a3-3780-44c4-88ea-f67cb2070251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86abf563f8af4778972e6fca2252d316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:30:37Z,use_quota=True,user_id='c2683d16b2f4406a8c518a55fa284f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f28b7d-283b-41ca-b745-98d67e4fc0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f28b7d-283b-41ca-b745-98d67e4fc0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5ea62f-6e6c-4658-b595-e15a0df5172e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5ea62f-6e6c-4658-b595-e15a0df5172e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17be28a3-3780-44c4-88ea-f67cb2070251', 'volume_name': 'volume-17be28a3-3780-44c4-88ea-f67cb2070251', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac49530-d465-4528-ad9d-925605ba3401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac49530-d465-4528-ad9d-925605ba3401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421a66f6-2f1e-4e99-b77e-c3b79a55f6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:37 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Volume 17be28a3-3780-44c4-88ea-f67cb2070251: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17be28a3-3780-44c4-88ea-f67cb2070251', 'volume_size': 1} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Flow 'volume_create_manager' (f7fea2a9-5244-4a62-9155-3be1e975d35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a020700b-474a-4511-833d-9b174099d337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a020700b-474a-4511-833d-9b174099d337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1227929328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790f4024-20c1-4033-8e88-8e4af6129af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86abf563f8af4778972e6fca2252d316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:30:38Z,use_quota=True,user_id='c2683d16b2f4406a8c518a55fa284f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647f0c9b-cb3b-444e-b338-33ed84259d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647f0c9b-cb3b-444e-b338-33ed84259d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c399dc-22c0-4446-bc59-fe37ab78988f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:37 devstack sudo[113962]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c399dc-22c0-4446-bc59-fe37ab78988f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '790f4024-20c1-4033-8e88-8e4af6129af8', 'volume_name': 'volume-790f4024-20c1-4033-8e88-8e4af6129af8', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52759c3d-7d30-4788-a05d-b255d9eeb601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52759c3d-7d30-4788-a05d-b255d9eeb601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a687ffec-af41-47e2-bdfe-0658cf111cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:37 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Volume 790f4024-20c1-4033-8e88-8e4af6129af8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-790f4024-20c1-4033-8e88-8e4af6129af8', 'volume_size': 1} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-673f30b7-11d0-4d6c-9316-2b56cdd3df12" returned: 0 in 0.770s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.431s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1584847493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bb877a7-807e-4a3a-adef-4ba7641d2389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86abf563f8af4778972e6fca2252d316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:30:36Z,use_quota=True,user_id='c2683d16b2f4406a8c518a55fa284f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Creating volume 2bb877a7-807e-4a3a-adef-4ba7641d2389 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:30:37 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2bb877a7-807e-4a3a-adef-4ba7641d2389 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:37 devstack sudo[113965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2bb877a7-807e-4a3a-adef-4ba7641d2389 1073741824 Jun 30 16:30:37 devstack sudo[113965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:37 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c04cee6-0c5f-492d-816f-a4ea4a1b3a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-673f30b7-11d0-4d6c-9316-2b56cdd3df12', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f0d0c8-2b26-4054-a735-6fd4425f3616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:38 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Volume volume-673f30b7-11d0-4d6c-9316-2b56cdd3df12 (673f30b7-11d0-4d6c-9316-2b56cdd3df12): created successfully Jun 30 16:30:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f0d0c8-2b26-4054-a735-6fd4425f3616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Flow 'volume_create_manager' (94c733b4-1d7d-40d5-9412-7afeba4cb5b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:30:38 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-de1a950c-e07c-48a0-9a06-bd88d882b202 tempest-CreateVolumesFromSnapshotTest-205532439 None] Created volume successfully. Jun 30 16:30:38 devstack sudo[113965]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2bb877a7-807e-4a3a-adef-4ba7641d2389 1073741824" returned: 0 in 0.954s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2bb877a7-807e-4a3a-adef-4ba7641d2389 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:38 devstack sudo[113970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2bb877a7-807e-4a3a-adef-4ba7641d2389 Jun 30 16:30:38 devstack sudo[113970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:39 devstack sudo[113970]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2bb877a7-807e-4a3a-adef-4ba7641d2389" returned: 0 in 0.676s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:30:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:30:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.514s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:30:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1550107429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f97240-edf0-4c35-93ae-f6a00bb3a7bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86abf563f8af4778972e6fca2252d316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:30:37Z,use_quota=True,user_id='c2683d16b2f4406a8c518a55fa284f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:30:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Creating volume 29f97240-edf0-4c35-93ae-f6a00bb3a7bc {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:30:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:30:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:30:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:30:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:30:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:30:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:30:39 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:30:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29f97240-edf0-4c35-93ae-f6a00bb3a7bc 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:39 devstack sudo[113973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29f97240-edf0-4c35-93ae-f6a00bb3a7bc 1073741824 Jun 30 16:30:39 devstack sudo[113973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24dee1d8-9da9-40c5-8993-2cd70382edf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bb877a7-807e-4a3a-adef-4ba7641d2389', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c275f934-f8bc-4555-93ba-2b5d860f584e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:39 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Volume volume-2bb877a7-807e-4a3a-adef-4ba7641d2389 (2bb877a7-807e-4a3a-adef-4ba7641d2389): created successfully Jun 30 16:30:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c275f934-f8bc-4555-93ba-2b5d860f584e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Flow 'volume_create_manager' (99dd2a13-063b-4af3-ac21-7eeaad349c5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:30:39 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-c040a2b5-25aa-4029-a2d2-c3a623633c7c tempest-CreateVolumesFromSnapshotTest-205532439 None] Created volume successfully. Jun 30 16:30:40 devstack sudo[113973]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29f97240-edf0-4c35-93ae-f6a00bb3a7bc 1073741824" returned: 0 in 1.037s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29f97240-edf0-4c35-93ae-f6a00bb3a7bc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:40 devstack sudo[113978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29f97240-edf0-4c35-93ae-f6a00bb3a7bc Jun 30 16:30:40 devstack sudo[113978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:41 devstack sudo[113978]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29f97240-edf0-4c35-93ae-f6a00bb3a7bc" returned: 0 in 0.774s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] <== create_volume: return (1856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:30:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:30:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.927s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:30:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1854958596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17be28a3-3780-44c4-88ea-f67cb2070251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86abf563f8af4778972e6fca2252d316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:30:37Z,use_quota=True,user_id='c2683d16b2f4406a8c518a55fa284f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:30:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Creating volume 17be28a3-3780-44c4-88ea-f67cb2070251 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:30:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:30:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:30:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:30:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:30:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:30:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:30:41 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:30:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17be28a3-3780-44c4-88ea-f67cb2070251 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:41 devstack sudo[113981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17be28a3-3780-44c4-88ea-f67cb2070251 1073741824 Jun 30 16:30:41 devstack sudo[113981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:41 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a9f55f-17fc-4d04-a156-0d96ff8d81c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29f97240-edf0-4c35-93ae-f6a00bb3a7bc', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:41 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b3f5a5-93b3-4564-beb6-4ff456ad2986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:41 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Volume volume-29f97240-edf0-4c35-93ae-f6a00bb3a7bc (29f97240-edf0-4c35-93ae-f6a00bb3a7bc): created successfully Jun 30 16:30:41 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b3f5a5-93b3-4564-beb6-4ff456ad2986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:41 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Flow 'volume_create_manager' (73763cb4-c88b-468a-9371-bd4bc6a1268b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:30:41 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-ca4995ea-457c-44f9-a280-4ed34ff6e6ad tempest-CreateVolumesFromSnapshotTest-205532439 None] Created volume successfully. Jun 30 16:30:42 devstack sudo[113981]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17be28a3-3780-44c4-88ea-f67cb2070251 1073741824" returned: 0 in 1.026s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17be28a3-3780-44c4-88ea-f67cb2070251 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:42 devstack sudo[113987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17be28a3-3780-44c4-88ea-f67cb2070251 Jun 30 16:30:42 devstack sudo[113987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:43 devstack sudo[113987]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17be28a3-3780-44c4-88ea-f67cb2070251" returned: 0 in 0.726s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:43 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:30:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:30:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.358s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:30:43 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1227929328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790f4024-20c1-4033-8e88-8e4af6129af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86abf563f8af4778972e6fca2252d316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:30:38Z,use_quota=True,user_id='c2683d16b2f4406a8c518a55fa284f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:30:43 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Creating volume 790f4024-20c1-4033-8e88-8e4af6129af8 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:30:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:30:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:30:43 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:30:43 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:30:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:30:43 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:30:43 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:30:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-790f4024-20c1-4033-8e88-8e4af6129af8 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:43 devstack sudo[113990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-790f4024-20c1-4033-8e88-8e4af6129af8 1073741824 Jun 30 16:30:43 devstack sudo[113990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:43 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421a66f6-2f1e-4e99-b77e-c3b79a55f6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17be28a3-3780-44c4-88ea-f67cb2070251', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:43 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec30db4c-234b-4f3c-8389-c8f2c99052f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:43 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Volume volume-17be28a3-3780-44c4-88ea-f67cb2070251 (17be28a3-3780-44c4-88ea-f67cb2070251): created successfully Jun 30 16:30:43 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec30db4c-234b-4f3c-8389-c8f2c99052f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:43 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Flow 'volume_create_manager' (78e01e8d-8b11-4a6c-954b-5828df7fa2bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:30:43 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-fe8233e5-6620-49fb-9de5-77738b5f9ac7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Created volume successfully. Jun 30 16:30:44 devstack sudo[113990]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-790f4024-20c1-4033-8e88-8e4af6129af8 1073741824" returned: 0 in 0.934s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-790f4024-20c1-4033-8e88-8e4af6129af8 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:44 devstack sudo[113995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-790f4024-20c1-4033-8e88-8e4af6129af8 Jun 30 16:30:44 devstack sudo[113995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:45 devstack sudo[113995]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-790f4024-20c1-4033-8e88-8e4af6129af8" returned: 0 in 0.826s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:45 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:30:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:30:45 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a687ffec-af41-47e2-bdfe-0658cf111cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-790f4024-20c1-4033-8e88-8e4af6129af8', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:45 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f22287-36f3-4fa0-867a-959ad9641d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:30:45 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Volume volume-790f4024-20c1-4033-8e88-8e4af6129af8 (790f4024-20c1-4033-8e88-8e4af6129af8): created successfully Jun 30 16:30:45 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f22287-36f3-4fa0-867a-959ad9641d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:30:45 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Flow 'volume_create_manager' (f7fea2a9-5244-4a62-9155-3be1e975d35d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:30:45 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-ad17b985-1525-4580-b660-6898ba839de0 tempest-CreateVolumesFromSnapshotTest-205532439 None] Created volume successfully. Jun 30 16:30:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-da11abe8-c186-4a1c-8b4f-a95910b685a5 tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "cinder-790f4024-20c1-4033-8e88-8e4af6129af8-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:30:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-da11abe8-c186-4a1c-8b4f-a95910b685a5 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-790f4024-20c1-4033-8e88-8e4af6129af8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:30:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-da11abe8-c186-4a1c-8b4f-a95910b685a5 tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "cinder-quobyte-790f4024-20c1-4033-8e88-8e4af6129af8" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:30:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-da11abe8-c186-4a1c-8b4f-a95910b685a5 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-quobyte-790f4024-20c1-4033-8e88-8e4af6129af8" acquired by "delete_volume" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:30:45 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ea50fb-b89f-402f-a5a0-26a9b5ec11c9]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:30:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-da11abe8-c186-4a1c-8b4f-a95910b685a5 tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-790f4024-20c1-4033-8e88-8e4af6129af8 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:45 devstack sudo[114004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-790f4024-20c1-4033-8e88-8e4af6129af8 Jun 30 16:30:45 devstack sudo[114004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:46 devstack sudo[114004]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-da11abe8-c186-4a1c-8b4f-a95910b685a5 tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-790f4024-20c1-4033-8e88-8e4af6129af8" returned: 0 in 0.889s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-da11abe8-c186-4a1c-8b4f-a95910b685a5 tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-790f4024-20c1-4033-8e88-8e4af6129af8 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:46 devstack sudo[114009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-790f4024-20c1-4033-8e88-8e4af6129af8 Jun 30 16:30:46 devstack sudo[114009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:47 devstack sudo[114009]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-da11abe8-c186-4a1c-8b4f-a95910b685a5 tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-790f4024-20c1-4033-8e88-8e4af6129af8" returned: 0 in 0.792s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:47 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-da11abe8-c186-4a1c-8b4f-a95910b685a5 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-quobyte-790f4024-20c1-4033-8e88-8e4af6129af8" released by "delete_volume" :: held 1.724s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:30:47 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-da11abe8-c186-4a1c-8b4f-a95910b685a5 tempest-CreateVolumesFromSnapshotTest-205532439 None] Created reservations ['919ee9b6-8106-4e05-9753-0adf44065a37', '6b712131-1491-4f5d-a58b-c5ea9fd6b5bd', 'c8d56ac5-c2f7-4a5e-b1d7-f070a4df4cf2', 'df65ea2c-0561-4f4a-82fa-daae1fc9f400'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:30:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-da11abe8-c186-4a1c-8b4f-a95910b685a5 tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:30:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-da11abe8-c186-4a1c-8b4f-a95910b685a5 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:30:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-da11abe8-c186-4a1c-8b4f-a95910b685a5 tempest-CreateVolumesFromSnapshotTest-205532439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:30:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-da11abe8-c186-4a1c-8b4f-a95910b685a5 tempest-CreateVolumesFromSnapshotTest-205532439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:30:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-da11abe8-c186-4a1c-8b4f-a95910b685a5 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:30:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-da11abe8-c186-4a1c-8b4f-a95910b685a5 tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:47 devstack sudo[114013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:30:47 devstack sudo[114013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:47 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3fff6580-2485-4346-8d37-1e84f5148a8b tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "cinder-17be28a3-3780-44c4-88ea-f67cb2070251-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:30:47 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3fff6580-2485-4346-8d37-1e84f5148a8b tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-17be28a3-3780-44c4-88ea-f67cb2070251-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:30:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3fff6580-2485-4346-8d37-1e84f5148a8b tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "cinder-quobyte-17be28a3-3780-44c4-88ea-f67cb2070251" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:30:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3fff6580-2485-4346-8d37-1e84f5148a8b tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-quobyte-17be28a3-3780-44c4-88ea-f67cb2070251" acquired by "delete_volume" :: waited 0.025s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:30:48 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[46491061-e635-4ca8-afed-c22d0112dc22]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:30:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3fff6580-2485-4346-8d37-1e84f5148a8b tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17be28a3-3780-44c4-88ea-f67cb2070251 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:48 devstack sudo[114015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17be28a3-3780-44c4-88ea-f67cb2070251 Jun 30 16:30:48 devstack sudo[114015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:48 devstack sudo[114013]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-da11abe8-c186-4a1c-8b4f-a95910b685a5 tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.843s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:48 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-da11abe8-c186-4a1c-8b4f-a95910b685a5 tempest-CreateVolumesFromSnapshotTest-205532439 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:30:48 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-da11abe8-c186-4a1c-8b4f-a95910b685a5 tempest-CreateVolumesFromSnapshotTest-205532439 None] Deleted volume successfully. Jun 30 16:30:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-da11abe8-c186-4a1c-8b4f-a95910b685a5 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-790f4024-20c1-4033-8e88-8e4af6129af8-delete_volume" released by "delete_volume" :: held 2.838s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:30:49 devstack sudo[114015]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3fff6580-2485-4346-8d37-1e84f5148a8b tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17be28a3-3780-44c4-88ea-f67cb2070251" returned: 0 in 0.925s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3fff6580-2485-4346-8d37-1e84f5148a8b tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17be28a3-3780-44c4-88ea-f67cb2070251 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:49 devstack sudo[114021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17be28a3-3780-44c4-88ea-f67cb2070251 Jun 30 16:30:49 devstack sudo[114021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:49 devstack sudo[114021]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3fff6580-2485-4346-8d37-1e84f5148a8b tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-17be28a3-3780-44c4-88ea-f67cb2070251" returned: 0 in 0.723s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:49 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3fff6580-2485-4346-8d37-1e84f5148a8b tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-quobyte-17be28a3-3780-44c4-88ea-f67cb2070251" released by "delete_volume" :: held 1.715s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:30:49 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-3fff6580-2485-4346-8d37-1e84f5148a8b tempest-CreateVolumesFromSnapshotTest-205532439 None] Created reservations ['87089c01-5450-4bb3-91c4-2587ceb45891', '1a5458f6-1532-49f9-a726-c2911250d1b1', 'e5c513fa-4e24-40fa-bc8e-0907f889daf5', '49b39764-8726-44d1-af27-58d52175a6bb'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:30:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3fff6580-2485-4346-8d37-1e84f5148a8b tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:30:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3fff6580-2485-4346-8d37-1e84f5148a8b tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:30:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3fff6580-2485-4346-8d37-1e84f5148a8b tempest-CreateVolumesFromSnapshotTest-205532439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:30:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-3fff6580-2485-4346-8d37-1e84f5148a8b tempest-CreateVolumesFromSnapshotTest-205532439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:30:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-3fff6580-2485-4346-8d37-1e84f5148a8b tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:30:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3fff6580-2485-4346-8d37-1e84f5148a8b tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:49 devstack sudo[114024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:30:49 devstack sudo[114024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ff2429bb-5248-4396-9d1c-4fadcb1ad0a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "cinder-29f97240-edf0-4c35-93ae-f6a00bb3a7bc-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:30:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ff2429bb-5248-4396-9d1c-4fadcb1ad0a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-29f97240-edf0-4c35-93ae-f6a00bb3a7bc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:30:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ff2429bb-5248-4396-9d1c-4fadcb1ad0a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "cinder-quobyte-29f97240-edf0-4c35-93ae-f6a00bb3a7bc" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:30:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ff2429bb-5248-4396-9d1c-4fadcb1ad0a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-quobyte-29f97240-edf0-4c35-93ae-f6a00bb3a7bc" acquired by "delete_volume" :: waited 0.016s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:30:50 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0948f4-a640-4fad-86d2-5e2d66a45f0c]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:30:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ff2429bb-5248-4396-9d1c-4fadcb1ad0a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29f97240-edf0-4c35-93ae-f6a00bb3a7bc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:50 devstack sudo[114026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29f97240-edf0-4c35-93ae-f6a00bb3a7bc Jun 30 16:30:50 devstack sudo[114026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:50 devstack sudo[114024]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-3fff6580-2485-4346-8d37-1e84f5148a8b tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.827s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:50 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-3fff6580-2485-4346-8d37-1e84f5148a8b tempest-CreateVolumesFromSnapshotTest-205532439 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:30:50 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-3fff6580-2485-4346-8d37-1e84f5148a8b tempest-CreateVolumesFromSnapshotTest-205532439 None] Deleted volume successfully. Jun 30 16:30:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-3fff6580-2485-4346-8d37-1e84f5148a8b tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-17be28a3-3780-44c4-88ea-f67cb2070251-delete_volume" released by "delete_volume" :: held 2.818s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:30:51 devstack sudo[114026]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ff2429bb-5248-4396-9d1c-4fadcb1ad0a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29f97240-edf0-4c35-93ae-f6a00bb3a7bc" returned: 0 in 0.927s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ff2429bb-5248-4396-9d1c-4fadcb1ad0a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29f97240-edf0-4c35-93ae-f6a00bb3a7bc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:51 devstack sudo[114032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29f97240-edf0-4c35-93ae-f6a00bb3a7bc Jun 30 16:30:51 devstack sudo[114032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:52 devstack sudo[114032]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ff2429bb-5248-4396-9d1c-4fadcb1ad0a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-29f97240-edf0-4c35-93ae-f6a00bb3a7bc" returned: 0 in 0.725s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:52 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ff2429bb-5248-4396-9d1c-4fadcb1ad0a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-quobyte-29f97240-edf0-4c35-93ae-f6a00bb3a7bc" released by "delete_volume" :: held 1.705s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:30:52 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-ff2429bb-5248-4396-9d1c-4fadcb1ad0a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Created reservations ['277db341-fcba-44b7-a0f0-a72979f702e0', 'b2af4c32-9316-4e56-80e5-6e5bcc7e6dfb', 'ab962554-6e1f-4ffa-9b24-95b6e18fde9e', '3b7ca99e-abed-4582-b77d-c537bc4f7bd6'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:30:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ff2429bb-5248-4396-9d1c-4fadcb1ad0a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:30:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ff2429bb-5248-4396-9d1c-4fadcb1ad0a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:30:52 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ff2429bb-5248-4396-9d1c-4fadcb1ad0a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:30:52 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ff2429bb-5248-4396-9d1c-4fadcb1ad0a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:30:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ff2429bb-5248-4396-9d1c-4fadcb1ad0a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:30:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ff2429bb-5248-4396-9d1c-4fadcb1ad0a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:52 devstack sudo[114037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:30:52 devstack sudo[114037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:52 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cba8fa67-d99d-41de-bec8-aac2ae35209d tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "cinder-2bb877a7-807e-4a3a-adef-4ba7641d2389-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:30:52 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cba8fa67-d99d-41de-bec8-aac2ae35209d tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-2bb877a7-807e-4a3a-adef-4ba7641d2389-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:30:52 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cba8fa67-d99d-41de-bec8-aac2ae35209d tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "cinder-quobyte-2bb877a7-807e-4a3a-adef-4ba7641d2389" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:30:52 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cba8fa67-d99d-41de-bec8-aac2ae35209d tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-quobyte-2bb877a7-807e-4a3a-adef-4ba7641d2389" acquired by "delete_volume" :: waited 0.015s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:30:52 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[4214d503-2d4d-4efc-a4a1-722dd157627b]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:30:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cba8fa67-d99d-41de-bec8-aac2ae35209d tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2bb877a7-807e-4a3a-adef-4ba7641d2389 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:52 devstack sudo[114039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2bb877a7-807e-4a3a-adef-4ba7641d2389 Jun 30 16:30:52 devstack sudo[114039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:52 devstack sudo[114037]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ff2429bb-5248-4396-9d1c-4fadcb1ad0a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.740s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:52 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-ff2429bb-5248-4396-9d1c-4fadcb1ad0a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:30:52 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-ff2429bb-5248-4396-9d1c-4fadcb1ad0a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Deleted volume successfully. Jun 30 16:30:53 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ff2429bb-5248-4396-9d1c-4fadcb1ad0a1 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-29f97240-edf0-4c35-93ae-f6a00bb3a7bc-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:30:53 devstack sudo[114039]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cba8fa67-d99d-41de-bec8-aac2ae35209d tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2bb877a7-807e-4a3a-adef-4ba7641d2389" returned: 0 in 0.820s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cba8fa67-d99d-41de-bec8-aac2ae35209d tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2bb877a7-807e-4a3a-adef-4ba7641d2389 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:53 devstack sudo[114046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2bb877a7-807e-4a3a-adef-4ba7641d2389 Jun 30 16:30:53 devstack sudo[114046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:54 devstack sudo[114046]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cba8fa67-d99d-41de-bec8-aac2ae35209d tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-2bb877a7-807e-4a3a-adef-4ba7641d2389" returned: 0 in 0.684s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cba8fa67-d99d-41de-bec8-aac2ae35209d tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-quobyte-2bb877a7-807e-4a3a-adef-4ba7641d2389" released by "delete_volume" :: held 1.559s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:30:54 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-cba8fa67-d99d-41de-bec8-aac2ae35209d tempest-CreateVolumesFromSnapshotTest-205532439 None] Created reservations ['f1089364-cf2c-4da7-81c7-ecadb6245502', '361ea0bc-d123-47b0-8be1-3599469fc422', '0e14376a-735c-4884-a9a3-adfeea4f5d46', '2f89748b-6bd8-47f6-9b70-b4cff3f6d1c1'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:30:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cba8fa67-d99d-41de-bec8-aac2ae35209d tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:30:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cba8fa67-d99d-41de-bec8-aac2ae35209d tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:30:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cba8fa67-d99d-41de-bec8-aac2ae35209d tempest-CreateVolumesFromSnapshotTest-205532439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:30:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cba8fa67-d99d-41de-bec8-aac2ae35209d tempest-CreateVolumesFromSnapshotTest-205532439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:30:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cba8fa67-d99d-41de-bec8-aac2ae35209d tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:30:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cba8fa67-d99d-41de-bec8-aac2ae35209d tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:54 devstack sudo[114049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:30:54 devstack sudo[114049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5ab6ccea-a7f5-4aba-8765-e490983c795a tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "cinder-673f30b7-11d0-4d6c-9316-2b56cdd3df12-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:30:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5ab6ccea-a7f5-4aba-8765-e490983c795a tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-673f30b7-11d0-4d6c-9316-2b56cdd3df12-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:30:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5ab6ccea-a7f5-4aba-8765-e490983c795a tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "cinder-quobyte-673f30b7-11d0-4d6c-9316-2b56cdd3df12" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:30:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5ab6ccea-a7f5-4aba-8765-e490983c795a tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-quobyte-673f30b7-11d0-4d6c-9316-2b56cdd3df12" acquired by "delete_volume" :: waited 0.028s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:30:54 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0927288-ffda-4e91-9daa-fc02b9639046]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:30:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5ab6ccea-a7f5-4aba-8765-e490983c795a tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-673f30b7-11d0-4d6c-9316-2b56cdd3df12 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:55 devstack sudo[114049]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cba8fa67-d99d-41de-bec8-aac2ae35209d tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.698s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:55 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-cba8fa67-d99d-41de-bec8-aac2ae35209d tempest-CreateVolumesFromSnapshotTest-205532439 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:30:55 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-cba8fa67-d99d-41de-bec8-aac2ae35209d tempest-CreateVolumesFromSnapshotTest-205532439 None] Deleted volume successfully. Jun 30 16:30:55 devstack sudo[114052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-673f30b7-11d0-4d6c-9316-2b56cdd3df12 Jun 30 16:30:55 devstack sudo[114052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:55 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cba8fa67-d99d-41de-bec8-aac2ae35209d tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-2bb877a7-807e-4a3a-adef-4ba7641d2389-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:30:55 devstack sudo[114052]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5ab6ccea-a7f5-4aba-8765-e490983c795a tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-673f30b7-11d0-4d6c-9316-2b56cdd3df12" returned: 0 in 0.864s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5ab6ccea-a7f5-4aba-8765-e490983c795a tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-673f30b7-11d0-4d6c-9316-2b56cdd3df12 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:55 devstack sudo[114057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-673f30b7-11d0-4d6c-9316-2b56cdd3df12 Jun 30 16:30:55 devstack sudo[114057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:56 devstack sudo[114057]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5ab6ccea-a7f5-4aba-8765-e490983c795a tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-673f30b7-11d0-4d6c-9316-2b56cdd3df12" returned: 0 in 0.691s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:56 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5ab6ccea-a7f5-4aba-8765-e490983c795a tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-quobyte-673f30b7-11d0-4d6c-9316-2b56cdd3df12" released by "delete_volume" :: held 1.612s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:30:56 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-5ab6ccea-a7f5-4aba-8765-e490983c795a tempest-CreateVolumesFromSnapshotTest-205532439 None] Created reservations ['af7acfcf-c4b9-48e4-a498-64ab77f713bc', 'd62278ee-216d-429f-9fc3-b9954752dc58', '9d89fdef-22a6-470f-9f70-1945753a5c27', 'd23beaef-f6a6-4d75-9669-4ef103b66a0e'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:30:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5ab6ccea-a7f5-4aba-8765-e490983c795a tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:30:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5ab6ccea-a7f5-4aba-8765-e490983c795a tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:30:56 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5ab6ccea-a7f5-4aba-8765-e490983c795a tempest-CreateVolumesFromSnapshotTest-205532439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:30:56 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5ab6ccea-a7f5-4aba-8765-e490983c795a tempest-CreateVolumesFromSnapshotTest-205532439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:30:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5ab6ccea-a7f5-4aba-8765-e490983c795a tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:30:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5ab6ccea-a7f5-4aba-8765-e490983c795a tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:56 devstack sudo[114060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:30:56 devstack sudo[114060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:57 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d24c6b3b-73ef-4e97-be85-c96947e9daa7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "cinder-5a0d5283-68cd-454f-8f33-c0b210ea5ab4-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:30:57 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d24c6b3b-73ef-4e97-be85-c96947e9daa7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-5a0d5283-68cd-454f-8f33-c0b210ea5ab4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:30:57 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d24c6b3b-73ef-4e97-be85-c96947e9daa7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "cinder-quobyte-3ed65316-5707-4bcd-963d-127d421d8241" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:30:57 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d24c6b3b-73ef-4e97-be85-c96947e9daa7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-quobyte-3ed65316-5707-4bcd-963d-127d421d8241" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:30:57 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d24c6b3b-73ef-4e97-be85-c96947e9daa7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "cinder-quobyte-5a0d5283-68cd-454f-8f33-c0b210ea5ab4" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:30:57 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d24c6b3b-73ef-4e97-be85-c96947e9daa7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-quobyte-5a0d5283-68cd-454f-8f33-c0b210ea5ab4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:30:57 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-d24c6b3b-73ef-4e97-be85-c96947e9daa7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Deleting offline snapshot 5a0d5283-68cd-454f-8f33-c0b210ea5ab4 of volume 3ed65316-5707-4bcd-963d-127d421d8241 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:30:57 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-d24c6b3b-73ef-4e97-be85-c96947e9daa7 tempest-CreateVolumesFromSnapshotTest-205532439 None] snapshot_file for this snap is: volume-3ed65316-5707-4bcd-963d-127d421d8241.5a0d5283-68cd-454f-8f33-c0b210ea5ab4 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:30:57 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f84860d-a249-4589-9031-9ab3118aa970]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:30:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d24c6b3b-73ef-4e97-be85-c96947e9daa7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.5a0d5283-68cd-454f-8f33-c0b210ea5ab4 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:57 devstack sudo[114063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.5a0d5283-68cd-454f-8f33-c0b210ea5ab4 Jun 30 16:30:57 devstack sudo[114063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:57 devstack sudo[114060]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5ab6ccea-a7f5-4aba-8765-e490983c795a tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.712s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:57 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-5ab6ccea-a7f5-4aba-8765-e490983c795a tempest-CreateVolumesFromSnapshotTest-205532439 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:30:57 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-5ab6ccea-a7f5-4aba-8765-e490983c795a tempest-CreateVolumesFromSnapshotTest-205532439 None] Deleted volume successfully. Jun 30 16:30:57 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-5ab6ccea-a7f5-4aba-8765-e490983c795a tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-673f30b7-11d0-4d6c-9316-2b56cdd3df12-delete_volume" released by "delete_volume" :: held 2.578s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:30:58 devstack sudo[114063]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d24c6b3b-73ef-4e97-be85-c96947e9daa7 tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.5a0d5283-68cd-454f-8f33-c0b210ea5ab4" returned: 0 in 0.921s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-d24c6b3b-73ef-4e97-be85-c96947e9daa7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ed65316-5707-4bcd-963d-127d421d8241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:30:58 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[54423592-4589-4274-a31a-729e96c0ad48]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:30:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d24c6b3b-73ef-4e97-be85-c96947e9daa7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:58 devstack sudo[114069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241 Jun 30 16:30:58 devstack sudo[114069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:58 devstack sudo[114069]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d24c6b3b-73ef-4e97-be85-c96947e9daa7 tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241" returned: 0 in 0.770s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d24c6b3b-73ef-4e97-be85-c96947e9daa7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.5a0d5283-68cd-454f-8f33-c0b210ea5ab4 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:58 devstack sudo[114074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.5a0d5283-68cd-454f-8f33-c0b210ea5ab4 Jun 30 16:30:58 devstack sudo[114074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:30:59 devstack sudo[114074]: pam_unix(sudo:session): session closed for user root Jun 30 16:30:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d24c6b3b-73ef-4e97-be85-c96947e9daa7 tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.5a0d5283-68cd-454f-8f33-c0b210ea5ab4" returned: 0 in 0.762s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:30:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d24c6b3b-73ef-4e97-be85-c96947e9daa7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.5a0d5283-68cd-454f-8f33-c0b210ea5ab4 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:30:59 devstack sudo[114079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.5a0d5283-68cd-454f-8f33-c0b210ea5ab4 Jun 30 16:30:59 devstack sudo[114079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:00 devstack sudo[114079]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d24c6b3b-73ef-4e97-be85-c96947e9daa7 tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241.5a0d5283-68cd-454f-8f33-c0b210ea5ab4" returned: 0 in 0.667s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d24c6b3b-73ef-4e97-be85-c96947e9daa7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-quobyte-5a0d5283-68cd-454f-8f33-c0b210ea5ab4" released by "_delete_snapshot" :: held 3.248s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:31:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d24c6b3b-73ef-4e97-be85-c96947e9daa7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-quobyte-3ed65316-5707-4bcd-963d-127d421d8241" released by "delete_snapshot" :: held 3.273s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:31:00 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-d24c6b3b-73ef-4e97-be85-c96947e9daa7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Created reservations ['06c23084-49a9-44ad-8741-8e55410b6a0e', 'b544d4a0-d940-4fd6-aca9-d013b23bc004', '77086916-09c7-4f0f-9400-977713da5ca8', '69957406-ef75-4e45-bcc7-2a1ff0126d76'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:31:00 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-d24c6b3b-73ef-4e97-be85-c96947e9daa7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Delete snapshot completed successfully. Jun 30 16:31:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d24c6b3b-73ef-4e97-be85-c96947e9daa7 tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-5a0d5283-68cd-454f-8f33-c0b210ea5ab4-delete_snapshot" released by "delete_snapshot" :: held 3.415s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:31:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8a64df7e-c683-4cb8-a50b-a43811efa27a tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "cinder-3ed65316-5707-4bcd-963d-127d421d8241-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:31:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8a64df7e-c683-4cb8-a50b-a43811efa27a tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-3ed65316-5707-4bcd-963d-127d421d8241-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:31:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8a64df7e-c683-4cb8-a50b-a43811efa27a tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "cinder-quobyte-3ed65316-5707-4bcd-963d-127d421d8241" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:31:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8a64df7e-c683-4cb8-a50b-a43811efa27a tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-quobyte-3ed65316-5707-4bcd-963d-127d421d8241" acquired by "delete_volume" :: waited 0.014s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:31:01 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03d9c26-5ba9-4081-b2b4-894ed902c046]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:31:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8a64df7e-c683-4cb8-a50b-a43811efa27a tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:01 devstack sudo[114082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241 Jun 30 16:31:01 devstack sudo[114082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:02 devstack sudo[114082]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8a64df7e-c683-4cb8-a50b-a43811efa27a tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241" returned: 0 in 0.758s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8a64df7e-c683-4cb8-a50b-a43811efa27a tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:02 devstack sudo[114087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241 Jun 30 16:31:02 devstack sudo[114087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:02 devstack sudo[114087]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8a64df7e-c683-4cb8-a50b-a43811efa27a tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3ed65316-5707-4bcd-963d-127d421d8241" returned: 0 in 0.654s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:02 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8a64df7e-c683-4cb8-a50b-a43811efa27a tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-quobyte-3ed65316-5707-4bcd-963d-127d421d8241" released by "delete_volume" :: held 1.494s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:31:02 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-8a64df7e-c683-4cb8-a50b-a43811efa27a tempest-CreateVolumesFromSnapshotTest-205532439 None] Created reservations ['ddce263e-115b-46c1-bb28-f050eafbf1d2', '98afd81e-13cd-4603-8999-d09437ab4a6f', 'f58b992e-ea33-483c-9627-9fcbe70e725f', 'd5096ed2-8e68-4e03-b017-e6557d3e0a74'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:31:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8a64df7e-c683-4cb8-a50b-a43811efa27a tempest-CreateVolumesFromSnapshotTest-205532439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8a64df7e-c683-4cb8-a50b-a43811efa27a tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-8a64df7e-c683-4cb8-a50b-a43811efa27a tempest-CreateVolumesFromSnapshotTest-205532439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:31:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-8a64df7e-c683-4cb8-a50b-a43811efa27a tempest-CreateVolumesFromSnapshotTest-205532439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:31:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8a64df7e-c683-4cb8-a50b-a43811efa27a tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:31:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8a64df7e-c683-4cb8-a50b-a43811efa27a tempest-CreateVolumesFromSnapshotTest-205532439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:03 devstack sudo[114090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:31:03 devstack sudo[114090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:03 devstack sudo[114090]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8a64df7e-c683-4cb8-a50b-a43811efa27a tempest-CreateVolumesFromSnapshotTest-205532439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.681s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:03 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-8a64df7e-c683-4cb8-a50b-a43811efa27a tempest-CreateVolumesFromSnapshotTest-205532439 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:31:03 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-8a64df7e-c683-4cb8-a50b-a43811efa27a tempest-CreateVolumesFromSnapshotTest-205532439 None] Deleted volume successfully. Jun 30 16:31:03 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8a64df7e-c683-4cb8-a50b-a43811efa27a tempest-CreateVolumesFromSnapshotTest-205532439 None] Lock "cinder-3ed65316-5707-4bcd-963d-127d421d8241-delete_volume" released by "delete_volume" :: held 2.373s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:31:06 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:31:06 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Flow 'volume_create_manager' (1e2413b7-529f-4829-87d9-ab82062a35fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:31:06 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff28afc3-9e96-42aa-959c-985ab2c563d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:06 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff28afc3-9e96-42aa-959c-985ab2c563d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1532996030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1d29ef-8c74-4ee0-aa13-83fba37e064e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0825352b47a404b885c57d6c4dd976d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:31:07Z,use_quota=True,user_id='1d72f8d39b67498999bfa3d968cec3be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:06 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd9293ed-ade9-44e8-86e0-c185f5fe546c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:06 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd9293ed-ade9-44e8-86e0-c185f5fe546c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:06 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a9398e2-6b7e-45c4-9b64-38dc277c71bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:06 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a9398e2-6b7e-45c4-9b64-38dc277c71bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d1d29ef-8c74-4ee0-aa13-83fba37e064e', 'volume_name': 'volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:06 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (471d3aa2-0b7b-4137-9239-b1b29927328d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:06 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (471d3aa2-0b7b-4137-9239-b1b29927328d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:06 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fbe922-e0ef-4c2b-b77e-358504b360a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:06 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Volume 8d1d29ef-8c74-4ee0-aa13-83fba37e064e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e', 'volume_size': 1} Jun 30 16:31:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1532996030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1d29ef-8c74-4ee0-aa13-83fba37e064e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0825352b47a404b885c57d6c4dd976d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:31:07Z,use_quota=True,user_id='1d72f8d39b67498999bfa3d968cec3be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:31:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Creating volume 8d1d29ef-8c74-4ee0-aa13-83fba37e064e {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:31:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:31:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:31:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:31:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:31:06 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:31:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:06 devstack sudo[114095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e 1073741824 Jun 30 16:31:06 devstack sudo[114095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:07 devstack sudo[114095]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e 1073741824" returned: 0 in 0.970s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:07 devstack sudo[114103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e Jun 30 16:31:07 devstack sudo[114103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:08 devstack sudo[114103]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e" returned: 0 in 0.691s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:31:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:31:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fbe922-e0ef-4c2b-b77e-358504b360a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d955171-420d-41d6-a522-5d5f2387bd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:08 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Volume volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e (8d1d29ef-8c74-4ee0-aa13-83fba37e064e): created successfully Jun 30 16:31:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d955171-420d-41d6-a522-5d5f2387bd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Flow 'volume_create_manager' (1e2413b7-529f-4829-87d9-ab82062a35fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:31:08 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-325aa801-a295-40eb-b640-070978068ede tempest-VolumeDependencyTests-1891758089 None] Created volume successfully. Jun 30 16:31:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-edaa18d2-b7ab-418a-b4fe-9453cad59eaf tempest-VolumeDependencyTests-1891758089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-edaa18d2-b7ab-418a-b4fe-9453cad59eaf tempest-VolumeDependencyTests-1891758089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-edaa18d2-b7ab-418a-b4fe-9453cad59eaf tempest-VolumeDependencyTests-1891758089 None] Creating offline snapshot 058ac407-415e-4ac2-9a79-a23c13da2b17 of volume 8d1d29ef-8c74-4ee0-aa13-83fba37e064e {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:31:08 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[c911f564-5977-4fed-8ef6-27fbd62a9e7b]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:31:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edaa18d2-b7ab-418a-b4fe-9453cad59eaf tempest-VolumeDependencyTests-1891758089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:09 devstack sudo[114106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e Jun 30 16:31:09 devstack sudo[114106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:09 devstack sudo[114106]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edaa18d2-b7ab-418a-b4fe-9453cad59eaf tempest-VolumeDependencyTests-1891758089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e" returned: 0 in 0.877s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edaa18d2-b7ab-418a-b4fe-9453cad59eaf tempest-VolumeDependencyTests-1891758089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.058ac407-415e-4ac2-9a79-a23c13da2b17 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:09 devstack sudo[114111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.058ac407-415e-4ac2-9a79-a23c13da2b17 1G Jun 30 16:31:09 devstack sudo[114111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:10 devstack sudo[114111]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edaa18d2-b7ab-418a-b4fe-9453cad59eaf tempest-VolumeDependencyTests-1891758089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.058ac407-415e-4ac2-9a79-a23c13da2b17 1G" returned: 0 in 0.879s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edaa18d2-b7ab-418a-b4fe-9453cad59eaf tempest-VolumeDependencyTests-1891758089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.058ac407-415e-4ac2-9a79-a23c13da2b17 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:10 devstack sudo[114116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.058ac407-415e-4ac2-9a79-a23c13da2b17 Jun 30 16:31:10 devstack sudo[114116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:11 devstack sudo[114116]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edaa18d2-b7ab-418a-b4fe-9453cad59eaf tempest-VolumeDependencyTests-1891758089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.058ac407-415e-4ac2-9a79-a23c13da2b17" returned: 0 in 0.718s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:11 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-edaa18d2-b7ab-418a-b4fe-9453cad59eaf tempest-VolumeDependencyTests-1891758089 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.058ac407-415e-4ac2-9a79-a23c13da2b17 is being set with open permissions: ugo+rw Jun 30 16:31:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edaa18d2-b7ab-418a-b4fe-9453cad59eaf tempest-VolumeDependencyTests-1891758089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.058ac407-415e-4ac2-9a79-a23c13da2b17 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:11 devstack sudo[114122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.058ac407-415e-4ac2-9a79-a23c13da2b17 Jun 30 16:31:11 devstack sudo[114122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:12 devstack sudo[114122]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edaa18d2-b7ab-418a-b4fe-9453cad59eaf tempest-VolumeDependencyTests-1891758089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.058ac407-415e-4ac2-9a79-a23c13da2b17" returned: 0 in 0.759s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edaa18d2-b7ab-418a-b4fe-9453cad59eaf tempest-VolumeDependencyTests-1891758089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:12 devstack sudo[114159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.info Jun 30 16:31:12 devstack sudo[114159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:12 devstack sudo[114159]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edaa18d2-b7ab-418a-b4fe-9453cad59eaf tempest-VolumeDependencyTests-1891758089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.info" returned: 0 in 0.718s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:12 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-edaa18d2-b7ab-418a-b4fe-9453cad59eaf tempest-VolumeDependencyTests-1891758089 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.info is being set with open permissions: ugo+rw Jun 30 16:31:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edaa18d2-b7ab-418a-b4fe-9453cad59eaf tempest-VolumeDependencyTests-1891758089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:12 devstack sudo[114164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.info Jun 30 16:31:12 devstack sudo[114164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:13 devstack sudo[114164]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edaa18d2-b7ab-418a-b4fe-9453cad59eaf tempest-VolumeDependencyTests-1891758089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.info" returned: 0 in 0.688s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-edaa18d2-b7ab-418a-b4fe-9453cad59eaf tempest-VolumeDependencyTests-1891758089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.743s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:31:13 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-edaa18d2-b7ab-418a-b4fe-9453cad59eaf tempest-VolumeDependencyTests-1891758089 None] Create snapshot completed successfully Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Flow 'volume_create_manager' (308076b0-1ef9-4596-8d6e-fd723e07a311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5920782-7318-4c88-89ba-26664f3006d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5920782-7318-4c88-89ba-26664f3006d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1008545023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d4bdb6-bf2c-4e39-aa5b-417268426a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0825352b47a404b885c57d6c4dd976d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=058ac407-415e-4ac2-9a79-a23c13da2b17,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:31:15Z,use_quota=True,user_id='1d72f8d39b67498999bfa3d968cec3be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef9f769-b69c-442f-b612-4d8157e6f7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef9f769-b69c-442f-b612-4d8157e6f7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3309cced-9467-43c9-89db-ea3a8056474a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3309cced-9467-43c9-89db-ea3a8056474a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '98d4bdb6-bf2c-4e39-aa5b-417268426a59', 'volume_name': 'volume-98d4bdb6-bf2c-4e39-aa5b-417268426a59', 'volume_size': 1, 'snapshot_id': '058ac407-415e-4ac2-9a79-a23c13da2b17'}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf02aa4-dd38-4478-b6d4-f1f07fd09134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf02aa4-dd38-4478-b6d4-f1f07fd09134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc84678-69ac-4622-bb24-e0b4cb5221ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:14 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Volume 98d4bdb6-bf2c-4e39-aa5b-417268426a59: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-98d4bdb6-bf2c-4e39-aa5b-417268426a59', 'volume_size': 1, 'snapshot_id': '058ac407-415e-4ac2-9a79-a23c13da2b17'} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Acquiring lock "cinder-quobyte-058ac407-415e-4ac2-9a79-a23c13da2b17-98d4bdb6-bf2c-4e39-aa5b-417268426a59" by "_create_volume_from_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Lock "cinder-quobyte-058ac407-415e-4ac2-9a79-a23c13da2b17-98d4bdb6-bf2c-4e39-aa5b-417268426a59" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Creating volume 98d4bdb6-bf2c-4e39-aa5b-417268426a59 from snapshot 058ac407-415e-4ac2-9a79-a23c13da2b17 {{(pid=93781) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Acquiring lock "cinder-quobyte-98d4bdb6-bf2c-4e39-aa5b-417268426a59" by "_copy_volume_from_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Lock "cinder-quobyte-98d4bdb6-bf2c-4e39-aa5b-417268426a59" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] snapshot: 058ac407-415e-4ac2-9a79-a23c13da2b17, volume: 98d4bdb6-bf2c-4e39-aa5b-417268426a59, {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8659b23-7f47-47a2-b742-aadbaf7ede71]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:31:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.058ac407-415e-4ac2-9a79-a23c13da2b17 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:15 devstack sudo[114167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.058ac407-415e-4ac2-9a79-a23c13da2b17 Jun 30 16:31:15 devstack sudo[114167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:15 devstack sudo[114167]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.058ac407-415e-4ac2-9a79-a23c13da2b17" returned: 0 in 0.794s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:31:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] will copy from snapshot at /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 30 16:31:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Creating direct copy from snapshot {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 30 16:31:15 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9d4e26-422b-45a9-bd2c-ecfaa40822ed]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:31:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:15 devstack sudo[114172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e Jun 30 16:31:15 devstack sudo[114172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:16 devstack sudo[114172]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e" returned: 0 in 0.848s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:16 devstack cinder-volume[93781]: DEBUG cinder.utils [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Path /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-98d4bdb6-bf2c-4e39-aa5b-417268426a59 not found in is_blk_device check {{(pid=93781) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 30 16:31:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-98d4bdb6-bf2c-4e39-aa5b-417268426a59 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:16 devstack sudo[114177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-98d4bdb6-bf2c-4e39-aa5b-417268426a59 Jun 30 16:31:16 devstack sudo[114177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:21 devstack sudo[114177]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-98d4bdb6-bf2c-4e39-aa5b-417268426a59" returned: 0 in 4.967s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:21 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd4c3f7-e056-4851-aef1-9baf721fd3b7]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:31:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:21 devstack sudo[114191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e Jun 30 16:31:21 devstack sudo[114191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:22 devstack sudo[114191]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e" returned: 0 in 0.976s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:22 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Image conversion details: src /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-98d4bdb6-bf2c-4e39-aa5b-417268426a59 {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:31:22 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Converted 1024.00 MB image at 206.12 MB/s Jun 30 16:31:22 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-98d4bdb6-bf2c-4e39-aa5b-417268426a59 is being set with open permissions: ugo+rw Jun 30 16:31:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-98d4bdb6-bf2c-4e39-aa5b-417268426a59 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:22 devstack sudo[114196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-98d4bdb6-bf2c-4e39-aa5b-417268426a59 Jun 30 16:31:22 devstack sudo[114196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:23 devstack sudo[114196]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-98d4bdb6-bf2c-4e39-aa5b-417268426a59" returned: 0 in 0.708s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Lock "cinder-quobyte-98d4bdb6-bf2c-4e39-aa5b-417268426a59" released by "_copy_volume_from_snapshot" :: held 8.392s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:31:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Lock "cinder-quobyte-058ac407-415e-4ac2-9a79-a23c13da2b17-98d4bdb6-bf2c-4e39-aa5b-417268426a59" released by "_create_volume_from_snapshot" :: held 8.426s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:31:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.443s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:31:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc84678-69ac-4622-bb24-e0b4cb5221ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98d4bdb6-bf2c-4e39-aa5b-417268426a59', 'volume_size': 1, 'snapshot_id': '058ac407-415e-4ac2-9a79-a23c13da2b17'}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66035cbf-38b6-43a9-af10-1791d18afa19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:23 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Volume volume-98d4bdb6-bf2c-4e39-aa5b-417268426a59 (98d4bdb6-bf2c-4e39-aa5b-417268426a59): created successfully Jun 30 16:31:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66035cbf-38b6-43a9-af10-1791d18afa19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Flow 'volume_create_manager' (308076b0-1ef9-4596-8d6e-fd723e07a311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:31:23 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-270f8da9-364d-48fc-bfab-1db222292fb3 tempest-VolumeDependencyTests-1891758089 None] Created volume successfully. Jun 30 16:31:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9725a7c1-8aaa-4efe-bd82-2a1ea28db32c tempest-VolumeDependencyTests-1891758089 None] Acquiring lock "cinder-058ac407-415e-4ac2-9a79-a23c13da2b17-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:31:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9725a7c1-8aaa-4efe-bd82-2a1ea28db32c tempest-VolumeDependencyTests-1891758089 None] Lock "cinder-058ac407-415e-4ac2-9a79-a23c13da2b17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:31:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9725a7c1-8aaa-4efe-bd82-2a1ea28db32c tempest-VolumeDependencyTests-1891758089 None] Acquiring lock "cinder-quobyte-8d1d29ef-8c74-4ee0-aa13-83fba37e064e" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:31:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9725a7c1-8aaa-4efe-bd82-2a1ea28db32c tempest-VolumeDependencyTests-1891758089 None] Lock "cinder-quobyte-8d1d29ef-8c74-4ee0-aa13-83fba37e064e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:31:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9725a7c1-8aaa-4efe-bd82-2a1ea28db32c tempest-VolumeDependencyTests-1891758089 None] Acquiring lock "cinder-quobyte-058ac407-415e-4ac2-9a79-a23c13da2b17" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:31:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9725a7c1-8aaa-4efe-bd82-2a1ea28db32c tempest-VolumeDependencyTests-1891758089 None] Lock "cinder-quobyte-058ac407-415e-4ac2-9a79-a23c13da2b17" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:31:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-9725a7c1-8aaa-4efe-bd82-2a1ea28db32c tempest-VolumeDependencyTests-1891758089 None] Deleting offline snapshot 058ac407-415e-4ac2-9a79-a23c13da2b17 of volume 8d1d29ef-8c74-4ee0-aa13-83fba37e064e {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:31:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-9725a7c1-8aaa-4efe-bd82-2a1ea28db32c tempest-VolumeDependencyTests-1891758089 None] snapshot_file for this snap is: volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.058ac407-415e-4ac2-9a79-a23c13da2b17 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:31:23 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[5385d6b2-9e5a-4ad6-81b1-eb842af08000]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:31:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9725a7c1-8aaa-4efe-bd82-2a1ea28db32c tempest-VolumeDependencyTests-1891758089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.058ac407-415e-4ac2-9a79-a23c13da2b17 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:23 devstack sudo[114199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.058ac407-415e-4ac2-9a79-a23c13da2b17 Jun 30 16:31:23 devstack sudo[114199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:24 devstack sudo[114199]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9725a7c1-8aaa-4efe-bd82-2a1ea28db32c tempest-VolumeDependencyTests-1891758089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.058ac407-415e-4ac2-9a79-a23c13da2b17" returned: 0 in 0.976s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:24 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-9725a7c1-8aaa-4efe-bd82-2a1ea28db32c tempest-VolumeDependencyTests-1891758089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:31:24 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1037442-a4d9-42c8-9a69-f279158cd524]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:31:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9725a7c1-8aaa-4efe-bd82-2a1ea28db32c tempest-VolumeDependencyTests-1891758089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:24 devstack sudo[114204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e Jun 30 16:31:24 devstack sudo[114204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:25 devstack sudo[114204]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9725a7c1-8aaa-4efe-bd82-2a1ea28db32c tempest-VolumeDependencyTests-1891758089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e" returned: 0 in 0.843s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9725a7c1-8aaa-4efe-bd82-2a1ea28db32c tempest-VolumeDependencyTests-1891758089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.058ac407-415e-4ac2-9a79-a23c13da2b17 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:25 devstack sudo[114209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.058ac407-415e-4ac2-9a79-a23c13da2b17 Jun 30 16:31:25 devstack sudo[114209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:26 devstack sudo[114209]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9725a7c1-8aaa-4efe-bd82-2a1ea28db32c tempest-VolumeDependencyTests-1891758089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.058ac407-415e-4ac2-9a79-a23c13da2b17" returned: 0 in 0.850s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9725a7c1-8aaa-4efe-bd82-2a1ea28db32c tempest-VolumeDependencyTests-1891758089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.058ac407-415e-4ac2-9a79-a23c13da2b17 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:26 devstack sudo[114214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.058ac407-415e-4ac2-9a79-a23c13da2b17 Jun 30 16:31:26 devstack sudo[114214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:27 devstack sudo[114214]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9725a7c1-8aaa-4efe-bd82-2a1ea28db32c tempest-VolumeDependencyTests-1891758089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e.058ac407-415e-4ac2-9a79-a23c13da2b17" returned: 0 in 0.722s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:27 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:UPDATE=77,cinder:SELECT=59,cinder:DELETE=10,cinder:INSERT=18 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:31:27 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=62,cinder:UPDATE=83,cinder:INSERT=19,cinder:DELETE=6 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:31:27 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9725a7c1-8aaa-4efe-bd82-2a1ea28db32c tempest-VolumeDependencyTests-1891758089 None] Lock "cinder-quobyte-058ac407-415e-4ac2-9a79-a23c13da2b17" released by "_delete_snapshot" :: held 3.534s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:31:27 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9725a7c1-8aaa-4efe-bd82-2a1ea28db32c tempest-VolumeDependencyTests-1891758089 None] Lock "cinder-quobyte-8d1d29ef-8c74-4ee0-aa13-83fba37e064e" released by "delete_snapshot" :: held 3.569s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:31:27 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-9725a7c1-8aaa-4efe-bd82-2a1ea28db32c tempest-VolumeDependencyTests-1891758089 None] Created reservations ['d09c47fb-9414-4bf0-be02-02d81d0b83ec', '8ef8726a-e23b-4873-b0ee-6135382989a1', '6aca3762-3017-4235-ac3f-97618e60e728', '381fff79-f7f0-417f-a97c-ce3a83be8404'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:31:27 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-9725a7c1-8aaa-4efe-bd82-2a1ea28db32c tempest-VolumeDependencyTests-1891758089 None] Delete snapshot completed successfully. Jun 30 16:31:27 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-9725a7c1-8aaa-4efe-bd82-2a1ea28db32c tempest-VolumeDependencyTests-1891758089 None] Lock "cinder-058ac407-415e-4ac2-9a79-a23c13da2b17-delete_snapshot" released by "delete_snapshot" :: held 3.743s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:31:27 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-966ba276-02e4-495f-bdab-21182bec53a2 tempest-VolumeDependencyTests-1891758089 None] Acquiring lock "cinder-8d1d29ef-8c74-4ee0-aa13-83fba37e064e-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:31:27 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-966ba276-02e4-495f-bdab-21182bec53a2 tempest-VolumeDependencyTests-1891758089 None] Lock "cinder-8d1d29ef-8c74-4ee0-aa13-83fba37e064e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:31:27 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-966ba276-02e4-495f-bdab-21182bec53a2 tempest-VolumeDependencyTests-1891758089 None] Acquiring lock "cinder-quobyte-8d1d29ef-8c74-4ee0-aa13-83fba37e064e" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:31:27 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-966ba276-02e4-495f-bdab-21182bec53a2 tempest-VolumeDependencyTests-1891758089 None] Lock "cinder-quobyte-8d1d29ef-8c74-4ee0-aa13-83fba37e064e" acquired by "delete_volume" :: waited 0.019s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:31:27 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[23672651-e110-4587-96ba-f4a683a4a5b2]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:31:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-966ba276-02e4-495f-bdab-21182bec53a2 tempest-VolumeDependencyTests-1891758089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:28 devstack sudo[114218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e Jun 30 16:31:28 devstack sudo[114218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:28 devstack sudo[114218]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-966ba276-02e4-495f-bdab-21182bec53a2 tempest-VolumeDependencyTests-1891758089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e" returned: 0 in 0.840s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-966ba276-02e4-495f-bdab-21182bec53a2 tempest-VolumeDependencyTests-1891758089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:28 devstack sudo[114223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e Jun 30 16:31:28 devstack sudo[114223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:29 devstack sudo[114223]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-966ba276-02e4-495f-bdab-21182bec53a2 tempest-VolumeDependencyTests-1891758089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-8d1d29ef-8c74-4ee0-aa13-83fba37e064e" returned: 0 in 0.778s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-966ba276-02e4-495f-bdab-21182bec53a2 tempest-VolumeDependencyTests-1891758089 None] Lock "cinder-quobyte-8d1d29ef-8c74-4ee0-aa13-83fba37e064e" released by "delete_volume" :: held 1.709s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:31:29 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-966ba276-02e4-495f-bdab-21182bec53a2 tempest-VolumeDependencyTests-1891758089 None] Created reservations ['55904c50-4ee1-4369-b3b4-ffb110468e06', 'e1d8287d-b316-4a9c-9e98-e4ade0118958', 'f20fdcd0-5e34-4f84-8fbf-3d46951539b6', '06175f27-cd00-42ab-beb0-534c1fef6743'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:31:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-966ba276-02e4-495f-bdab-21182bec53a2 tempest-VolumeDependencyTests-1891758089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-966ba276-02e4-495f-bdab-21182bec53a2 tempest-VolumeDependencyTests-1891758089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-966ba276-02e4-495f-bdab-21182bec53a2 tempest-VolumeDependencyTests-1891758089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:31:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-966ba276-02e4-495f-bdab-21182bec53a2 tempest-VolumeDependencyTests-1891758089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:31:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-966ba276-02e4-495f-bdab-21182bec53a2 tempest-VolumeDependencyTests-1891758089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:31:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-966ba276-02e4-495f-bdab-21182bec53a2 tempest-VolumeDependencyTests-1891758089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:29 devstack sudo[114226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:31:29 devstack sudo[114226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:30 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-548f8ced-8c06-4078-b54a-568217375a2c tempest-VolumeDependencyTests-1891758089 None] Acquiring lock "cinder-98d4bdb6-bf2c-4e39-aa5b-417268426a59-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:31:30 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-548f8ced-8c06-4078-b54a-568217375a2c tempest-VolumeDependencyTests-1891758089 None] Lock "cinder-98d4bdb6-bf2c-4e39-aa5b-417268426a59-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:31:30 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-548f8ced-8c06-4078-b54a-568217375a2c tempest-VolumeDependencyTests-1891758089 None] Acquiring lock "cinder-quobyte-98d4bdb6-bf2c-4e39-aa5b-417268426a59" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:31:30 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-548f8ced-8c06-4078-b54a-568217375a2c tempest-VolumeDependencyTests-1891758089 None] Lock "cinder-quobyte-98d4bdb6-bf2c-4e39-aa5b-417268426a59" acquired by "delete_volume" :: waited 0.022s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:31:30 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcaf8e0-549c-42b1-868a-00c26a1fc298]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:31:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-548f8ced-8c06-4078-b54a-568217375a2c tempest-VolumeDependencyTests-1891758089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-98d4bdb6-bf2c-4e39-aa5b-417268426a59 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:30 devstack sudo[114228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-98d4bdb6-bf2c-4e39-aa5b-417268426a59 Jun 30 16:31:30 devstack sudo[114228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:30 devstack sudo[114226]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-966ba276-02e4-495f-bdab-21182bec53a2 tempest-VolumeDependencyTests-1891758089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.873s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:30 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-966ba276-02e4-495f-bdab-21182bec53a2 tempest-VolumeDependencyTests-1891758089 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:31:30 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-966ba276-02e4-495f-bdab-21182bec53a2 tempest-VolumeDependencyTests-1891758089 None] Deleted volume successfully. Jun 30 16:31:30 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-966ba276-02e4-495f-bdab-21182bec53a2 tempest-VolumeDependencyTests-1891758089 None] Lock "cinder-8d1d29ef-8c74-4ee0-aa13-83fba37e064e-delete_volume" released by "delete_volume" :: held 2.826s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:31:31 devstack sudo[114228]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-548f8ced-8c06-4078-b54a-568217375a2c tempest-VolumeDependencyTests-1891758089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-98d4bdb6-bf2c-4e39-aa5b-417268426a59" returned: 0 in 0.879s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-548f8ced-8c06-4078-b54a-568217375a2c tempest-VolumeDependencyTests-1891758089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-98d4bdb6-bf2c-4e39-aa5b-417268426a59 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:31 devstack sudo[114234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-98d4bdb6-bf2c-4e39-aa5b-417268426a59 Jun 30 16:31:31 devstack sudo[114234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:31 devstack sudo[114234]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-548f8ced-8c06-4078-b54a-568217375a2c tempest-VolumeDependencyTests-1891758089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-98d4bdb6-bf2c-4e39-aa5b-417268426a59" returned: 0 in 0.764s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:31 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-548f8ced-8c06-4078-b54a-568217375a2c tempest-VolumeDependencyTests-1891758089 None] Lock "cinder-quobyte-98d4bdb6-bf2c-4e39-aa5b-417268426a59" released by "delete_volume" :: held 1.700s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:31:31 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-548f8ced-8c06-4078-b54a-568217375a2c tempest-VolumeDependencyTests-1891758089 None] Created reservations ['6be967a7-215b-40a3-b50a-35fac707dbc2', 'be4d4665-1b79-4c69-9e59-ad3fe978895b', '18315bac-38c9-47f9-9c57-2831d360f305', '98998c81-3ad1-4fcf-a79e-da7bcab4ed23'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:31:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-548f8ced-8c06-4078-b54a-568217375a2c tempest-VolumeDependencyTests-1891758089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-548f8ced-8c06-4078-b54a-568217375a2c tempest-VolumeDependencyTests-1891758089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-548f8ced-8c06-4078-b54a-568217375a2c tempest-VolumeDependencyTests-1891758089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:31:32 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-548f8ced-8c06-4078-b54a-568217375a2c tempest-VolumeDependencyTests-1891758089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:31:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-548f8ced-8c06-4078-b54a-568217375a2c tempest-VolumeDependencyTests-1891758089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:31:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-548f8ced-8c06-4078-b54a-568217375a2c tempest-VolumeDependencyTests-1891758089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:32 devstack sudo[114237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:31:32 devstack sudo[114237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:32 devstack sudo[114237]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-548f8ced-8c06-4078-b54a-568217375a2c tempest-VolumeDependencyTests-1891758089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.809s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:32 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-548f8ced-8c06-4078-b54a-568217375a2c tempest-VolumeDependencyTests-1891758089 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:31:32 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-548f8ced-8c06-4078-b54a-568217375a2c tempest-VolumeDependencyTests-1891758089 None] Deleted volume successfully. Jun 30 16:31:32 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-548f8ced-8c06-4078-b54a-568217375a2c tempest-VolumeDependencyTests-1891758089 None] Lock "cinder-98d4bdb6-bf2c-4e39-aa5b-417268426a59-delete_volume" released by "delete_volume" :: held 2.781s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:31:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:31:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:31:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:31:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:31:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:33 devstack sudo[114240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:31:33 devstack sudo[114240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:33 devstack sudo[114240]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.824s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:33 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:31:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:31:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 28 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:31:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:31:42 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=17,cinder:INSERT=7,cinder:UPDATE=21 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:31:42 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=12,cinder:INSERT=5,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Flow 'volume_create_manager' (1da7cb6b-0468-47e0-a75b-501f69798128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f597898b-6c49-48c4-a84b-91faa05e5f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f597898b-6c49-48c4-a84b-91faa05e5f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-332406726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7edaae5c12c64d078ebf0459ccf69831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:31:46Z,use_quota=True,user_id='f62d440d987849449c7af677116aa0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c020d15-e285-4c82-8d92-a4674728101b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c020d15-e285-4c82-8d92-a4674728101b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db115491-2570-4191-803f-8cf38288e245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db115491-2570-4191-803f-8cf38288e245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2', 'volume_name': 'volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80bc8b1-7092-4dbc-a863-25c014d1fea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80bc8b1-7092-4dbc-a863-25c014d1fea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf1cfe0-f6ea-4120-8cd2-3c2a5d5c8e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:46 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Volume 3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2', 'volume_size': 1} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-332406726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7edaae5c12c64d078ebf0459ccf69831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:31:46Z,use_quota=True,user_id='f62d440d987849449c7af677116aa0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Creating volume 3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:31:46 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:31:46 devstack sudo[114286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2 1073741824 Jun 30 16:31:46 devstack sudo[114286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Flow 'volume_create_manager' (59016479-a5ff-4f30-9210-c33177ac2534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94961039-d3eb-4ec5-a07e-a8a2643cc8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94961039-d3eb-4ec5-a07e-a8a2643cc8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1042722507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=199d3322-5ab3-4f2a-b39f-628386c2cc4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3cc545bbcf408285c8ffc03935b704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:31:46Z,use_quota=True,user_id='ceacf5e55e2f4e098730a9edbcc7c8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8a9bb2-c738-470c-9bb3-79de9a96df87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8a9bb2-c738-470c-9bb3-79de9a96df87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941ef159-87ce-4521-beaa-c9b23f4d33d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941ef159-87ce-4521-beaa-c9b23f4d33d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '199d3322-5ab3-4f2a-b39f-628386c2cc4f', 'volume_name': 'volume-199d3322-5ab3-4f2a-b39f-628386c2cc4f', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c771f8-d0a0-49de-b20c-6ca190e9ea40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c771f8-d0a0-49de-b20c-6ca190e9ea40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e82748-ef3d-46ef-9045-7c7909c7e190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:46 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Volume 199d3322-5ab3-4f2a-b39f-628386c2cc4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-199d3322-5ab3-4f2a-b39f-628386c2cc4f', 'volume_size': 1} Jun 30 16:31:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Flow 'volume_create_manager' (7fd50ee4-8560-4318-886f-cc51854ef838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0558cb0-d6fd-42b3-bde6-ee68ef1565f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0558cb0-d6fd-42b3-bde6-ee68ef1565f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-372515070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6e735b7-0676-4336-be85-4b1ffc4bed1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3cc545bbcf408285c8ffc03935b704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:31:47Z,use_quota=True,user_id='ceacf5e55e2f4e098730a9edbcc7c8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988e6724-6fd3-4f2c-afa1-2b1895e0c0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988e6724-6fd3-4f2c-afa1-2b1895e0c0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8876aad-8b1d-4c6e-bb0b-f8680039a1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8876aad-8b1d-4c6e-bb0b-f8680039a1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6e735b7-0676-4336-be85-4b1ffc4bed1b', 'volume_name': 'volume-a6e735b7-0676-4336-be85-4b1ffc4bed1b', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd4f6f2-c3ef-46ba-9db8-c813ad2b42bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd4f6f2-c3ef-46ba-9db8-c813ad2b42bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f1d3f9-f1e0-4b3c-9b83-56896282b462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:47 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Volume a6e735b7-0676-4336-be85-4b1ffc4bed1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6e735b7-0676-4336-be85-4b1ffc4bed1b', 'volume_size': 1} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Flow 'volume_create_manager' (40f56395-db6d-4a8a-92df-d15f6646bc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c0adc6-ce94-446b-8834-a72bf2a17e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c0adc6-ce94-446b-8834-a72bf2a17e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d207a5fe-d2e6-441f-acc5-2b06dad1146c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ba1dec6be7f4beabc1b2920ca6ab41c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:31:47Z,use_quota=True,user_id='538026796b884af8aece3c232385d916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa1fb04-1638-4c4c-a621-686cd79def3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa1fb04-1638-4c4c-a621-686cd79def3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288b84a5-269d-4a57-beba-01bb47d42aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288b84a5-269d-4a57-beba-01bb47d42aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd207a5fe-d2e6-441f-acc5-2b06dad1146c', 'volume_name': 'volume-d207a5fe-d2e6-441f-acc5-2b06dad1146c', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2cb853f-8cbb-41fd-8489-d27a097d95c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2cb853f-8cbb-41fd-8489-d27a097d95c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea4ebff-2a30-4c9e-91a4-9b83f1f272fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:47 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Volume d207a5fe-d2e6-441f-acc5-2b06dad1146c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d207a5fe-d2e6-441f-acc5-2b06dad1146c', 'volume_size': 1} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Flow 'volume_create_manager' (39af7c79-4179-4a41-bbf1-3e176eff705f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f2241a-9736-4952-88c3-4b59c3414dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f2241a-9736-4952-88c3-4b59c3414dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2024444572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=811cb929-5ce2-4bd2-8710-cb1f6407b85f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3cc545bbcf408285c8ffc03935b704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:31:48Z,use_quota=True,user_id='ceacf5e55e2f4e098730a9edbcc7c8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1333f75f-ebdb-41fa-9eff-fbe711aa6498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1333f75f-ebdb-41fa-9eff-fbe711aa6498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12ec2c2-ca82-49f5-8339-04f99fce9311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12ec2c2-ca82-49f5-8339-04f99fce9311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '811cb929-5ce2-4bd2-8710-cb1f6407b85f', 'volume_name': 'volume-811cb929-5ce2-4bd2-8710-cb1f6407b85f', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73dadd58-840b-4adc-8779-df7578ff3d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73dadd58-840b-4adc-8779-df7578ff3d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af75489-72e6-41e3-a66e-e43a2cfd02e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:47 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Volume 811cb929-5ce2-4bd2-8710-cb1f6407b85f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-811cb929-5ce2-4bd2-8710-cb1f6407b85f', 'volume_size': 1} Jun 30 16:31:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Flow 'volume_create_manager' (eeed50d5-3372-4eae-a470-5e7604ca999f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a2910b-5a57-4859-9105-afd75a34f61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a2910b-5a57-4859-9105-afd75a34f61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1073644939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c525a72c-f1da-4359-99b1-2e9a638cd43a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3cc545bbcf408285c8ffc03935b704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:31:48Z,use_quota=True,user_id='ceacf5e55e2f4e098730a9edbcc7c8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbbc042a-50e7-4a9c-80ca-dcf7d68ce2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbbc042a-50e7-4a9c-80ca-dcf7d68ce2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d09481b-856a-45b6-8138-03509b1b8625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d09481b-856a-45b6-8138-03509b1b8625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c525a72c-f1da-4359-99b1-2e9a638cd43a', 'volume_name': 'volume-c525a72c-f1da-4359-99b1-2e9a638cd43a', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e11e885-055f-4666-bc55-edb2b9deb553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e11e885-055f-4666-bc55-edb2b9deb553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d28b09-694c-4854-bef8-0f9614eed4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:48 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Volume c525a72c-f1da-4359-99b1-2e9a638cd43a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c525a72c-f1da-4359-99b1-2e9a638cd43a', 'volume_size': 1} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:48 devstack sudo[114286]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2 1073741824" returned: 0 in 1.673s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:48 devstack sudo[114294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2 Jun 30 16:31:48 devstack sudo[114294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Flow 'volume_create_manager' (312df5c8-abaa-4e32-ad93-51cdc2751783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319df3ff-5bce-4862-bf8a-498f527fcdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319df3ff-5bce-4862-bf8a-498f527fcdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1987863823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b95d57ff-a424-4bb0-8bb6-05cff43d3f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3cc545bbcf408285c8ffc03935b704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:31:49Z,use_quota=True,user_id='ceacf5e55e2f4e098730a9edbcc7c8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43de5816-1aa7-486e-8b85-06ed243e0c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43de5816-1aa7-486e-8b85-06ed243e0c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef486e2-0655-4a9e-9b8f-d46ec90572fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef486e2-0655-4a9e-9b8f-d46ec90572fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b95d57ff-a424-4bb0-8bb6-05cff43d3f19', 'volume_name': 'volume-b95d57ff-a424-4bb0-8bb6-05cff43d3f19', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c176ac88-3a87-4d1b-91b5-e120e1fff998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c176ac88-3a87-4d1b-91b5-e120e1fff998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff357eba-e209-416d-a4fc-9c2f15ba73ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:48 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Volume b95d57ff-a424-4bb0-8bb6-05cff43d3f19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b95d57ff-a424-4bb0-8bb6-05cff43d3f19', 'volume_size': 1} Jun 30 16:31:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:49 devstack sudo[114294]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2" returned: 0 in 0.843s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] <== create_volume: return (2590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:31:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.594s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:31:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.405s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1042722507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=199d3322-5ab3-4f2a-b39f-628386c2cc4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3cc545bbcf408285c8ffc03935b704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:31:46Z,use_quota=True,user_id='ceacf5e55e2f4e098730a9edbcc7c8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:31:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Creating volume 199d3322-5ab3-4f2a-b39f-628386c2cc4f {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:31:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:31:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:31:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:31:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:31:49 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:31:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-199d3322-5ab3-4f2a-b39f-628386c2cc4f 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf1cfe0-f6ea-4120-8cd2-3c2a5d5c8e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664a9053-c609-4740-b922-68c5300c07b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:49 devstack sudo[114297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-199d3322-5ab3-4f2a-b39f-628386c2cc4f 1073741824 Jun 30 16:31:49 devstack sudo[114297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:49 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Volume volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2 (3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2): created successfully Jun 30 16:31:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664a9053-c609-4740-b922-68c5300c07b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:49 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Flow 'volume_create_manager' (1da7cb6b-0468-47e0-a75b-501f69798128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:31:49 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-232ff048-d14b-4bd4-8d98-cec31d8de9c4 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Created volume successfully. Jun 30 16:31:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-08a4fe85-fc1a-4142-9962-4278eef74cde tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:50 devstack sudo[114297]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-199d3322-5ab3-4f2a-b39f-628386c2cc4f 1073741824" returned: 0 in 1.110s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-199d3322-5ab3-4f2a-b39f-628386c2cc4f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:50 devstack sudo[114303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-199d3322-5ab3-4f2a-b39f-628386c2cc4f Jun 30 16:31:50 devstack sudo[114303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:51 devstack sudo[114303]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-199d3322-5ab3-4f2a-b39f-628386c2cc4f" returned: 0 in 0.714s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.875s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-372515070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6e735b7-0676-4336-be85-4b1ffc4bed1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3cc545bbcf408285c8ffc03935b704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:31:47Z,use_quota=True,user_id='ceacf5e55e2f4e098730a9edbcc7c8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Creating volume a6e735b7-0676-4336-be85-4b1ffc4bed1b {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:31:51 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6e735b7-0676-4336-be85-4b1ffc4bed1b 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:51 devstack sudo[114306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6e735b7-0676-4336-be85-4b1ffc4bed1b 1073741824 Jun 30 16:31:51 devstack sudo[114306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e82748-ef3d-46ef-9045-7c7909c7e190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-199d3322-5ab3-4f2a-b39f-628386c2cc4f', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (563a5757-4775-40e4-b7b5-e533c437a5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:51 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Volume volume-199d3322-5ab3-4f2a-b39f-628386c2cc4f (199d3322-5ab3-4f2a-b39f-628386c2cc4f): created successfully Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (563a5757-4775-40e4-b7b5-e533c437a5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Flow 'volume_create_manager' (59016479-a5ff-4f30-9210-c33177ac2534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:31:51 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-9b3a6d23-0a26-4c9d-9e5c-ac225d8b9233 tempest-CreateVolumesFromImageTest-642548269 None] Created volume successfully. Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Flow 'volume_create_manager' (6a62ebb2-94ef-4aa7-82a7-7df56fa7a23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0a27db-980f-4b36-9894-4d4b366d29fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0a27db-980f-4b36-9894-4d4b366d29fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ad37dc-ccbc-4694-8f12-ea8f049b714c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d77e58c97d4b66971dfc1440325dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:31:51Z,use_quota=True,user_id='b88ed803e02f41df87544027f0d20327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6c0861a-fd6f-48e3-9b7a-78fd96c26d5c),volume_type_id=f6c0861a-fd6f-48e3-9b7a-78fd96c26d5c)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f90564d-3b66-41a6-a725-3e2fb7cc1afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f90564d-3b66-41a6-a725-3e2fb7cc1afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba864a3-4ca4-46d8-b4ac-1e94957f21db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.image.glance [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Creating Keystone auth plugin from conf {{(pid=93781) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba864a3-4ca4-46d8-b4ac-1e94957f21db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '41ad37dc-ccbc-4694-8f12-ea8f049b714c', 'volume_name': 'volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c', 'volume_size': 1, 'image_id': 'dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7fd555187320aeefe509d14d4cdf4895', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '78d77e58c97d4b66971dfc1440325dd7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '85e74444009497a8518fe5320fdcddefb72fb7bd022f18862be1563189e432c2be5b7bc0479f4f663eae9efca4952618a7c90144ec68859c624911977434bc13', 'id': 'dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab', 'created_at': datetime.datetime(2026, 6, 30, 14, 31, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 14, 31, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90ec65f-1150-4793-8cfd-cf4b9cb28b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90ec65f-1150-4793-8cfd-cf4b9cb28b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a666ff-1e3d-424c-b1a0-c0da9b7ad4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:51 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Volume 41ad37dc-ccbc-4694-8f12-ea8f049b714c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c', 'volume_size': 1, 'image_id': 'dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7fd555187320aeefe509d14d4cdf4895', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '78d77e58c97d4b66971dfc1440325dd7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '85e74444009497a8518fe5320fdcddefb72fb7bd022f18862be1563189e432c2be5b7bc0479f4f663eae9efca4952618a7c90144ec68859c624911977434bc13', 'id': 'dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab', 'created_at': datetime.datetime(2026, 6, 30, 14, 31, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 14, 31, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Trying to clone 41ad37dc-ccbc-4694-8f12-ea8f049b714c from image dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab at location (None, [{'url': 'file:///opt/stack/data/glance/images/dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab', 'metadata': {}}]). {{(pid=93781) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 30 16:31:51 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 30 16:31:51 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Image download 0.00 MB at 0.00 MB/s Jun 30 16:31:52 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0e6e99-2eb2-45be-bf56-27eda687032a]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:31:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:52 devstack sudo[114312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD Jun 30 16:31:52 devstack sudo[114312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:52 devstack sudo[114306]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6e735b7-0676-4336-be85-4b1ffc4bed1b 1073741824" returned: 0 in 1.001s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6e735b7-0676-4336-be85-4b1ffc4bed1b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:52 devstack sudo[114314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6e735b7-0676-4336-be85-4b1ffc4bed1b Jun 30 16:31:52 devstack sudo[114314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:52 devstack sudo[114312]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD" returned: 0 in 0.905s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:52 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:53 devstack sudo[114314]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6e735b7-0676-4336-be85-4b1ffc4bed1b" returned: 0 in 0.801s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:31:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:31:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.546s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d207a5fe-d2e6-441f-acc5-2b06dad1146c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ba1dec6be7f4beabc1b2920ca6ab41c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:31:47Z,use_quota=True,user_id='538026796b884af8aece3c232385d916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:31:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Creating volume d207a5fe-d2e6-441f-acc5-2b06dad1146c {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:31:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:31:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:31:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:31:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:31:53 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:31:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d207a5fe-d2e6-441f-acc5-2b06dad1146c 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:53 devstack sudo[114319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD Jun 30 16:31:53 devstack sudo[114319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:53 devstack sudo[114320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d207a5fe-d2e6-441f-acc5-2b06dad1146c 1073741824 Jun 30 16:31:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f1d3f9-f1e0-4b3c-9b83-56896282b462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6e735b7-0676-4336-be85-4b1ffc4bed1b', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:53 devstack sudo[114320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a449ebb2-59dc-4e89-aa4c-75f2da75fe38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:53 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Volume volume-a6e735b7-0676-4336-be85-4b1ffc4bed1b (a6e735b7-0676-4336-be85-4b1ffc4bed1b): created successfully Jun 30 16:31:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a449ebb2-59dc-4e89-aa4c-75f2da75fe38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Flow 'volume_create_manager' (7fd50ee4-8560-4318-886f-cc51854ef838) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:31:53 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-edad96cb-6a36-4021-8254-85f6c26f97b5 tempest-CreateVolumesFromImageTest-642548269 None] Created volume successfully. Jun 30 16:31:53 devstack sudo[114319]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD" returned: 1 in 0.870s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:31:53 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Temporary image dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab is fetched for user b88ed803e02f41df87544027f0d20327. {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 30 16:31:53 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc2dd20-f560-49e2-a515-3dbfff71d866]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:31:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:54 devstack sudo[114332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD Jun 30 16:31:54 devstack sudo[114332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:54 devstack sudo[114320]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d207a5fe-d2e6-441f-acc5-2b06dad1146c 1073741824" returned: 0 in 1.045s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d207a5fe-d2e6-441f-acc5-2b06dad1146c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:54 devstack sudo[114334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d207a5fe-d2e6-441f-acc5-2b06dad1146c Jun 30 16:31:54 devstack sudo[114334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:54 devstack sudo[114332]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD" returned: 0 in 0.861s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:54 devstack sudo[114334]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d207a5fe-d2e6-441f-acc5-2b06dad1146c" returned: 0 in 0.759s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:31:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:31:54 devstack sudo[114339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD Jun 30 16:31:54 devstack sudo[114339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.051s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2024444572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=811cb929-5ce2-4bd2-8710-cb1f6407b85f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3cc545bbcf408285c8ffc03935b704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:31:48Z,use_quota=True,user_id='ceacf5e55e2f4e098730a9edbcc7c8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:31:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Creating volume 811cb929-5ce2-4bd2-8710-cb1f6407b85f {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:31:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:31:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:31:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:31:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:31:54 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:31:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-811cb929-5ce2-4bd2-8710-cb1f6407b85f 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:54 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea4ebff-2a30-4c9e-91a4-9b83f1f272fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d207a5fe-d2e6-441f-acc5-2b06dad1146c', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:54 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d07069-8d84-4a20-af69-7bdc6f9690b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:54 devstack sudo[114342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-811cb929-5ce2-4bd2-8710-cb1f6407b85f 1073741824 Jun 30 16:31:54 devstack sudo[114342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:54 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Volume volume-d207a5fe-d2e6-441f-acc5-2b06dad1146c (d207a5fe-d2e6-441f-acc5-2b06dad1146c): created successfully Jun 30 16:31:54 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d07069-8d84-4a20-af69-7bdc6f9690b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:54 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Flow 'volume_create_manager' (40f56395-db6d-4a8a-92df-d15f6646bc8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:31:55 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-07fb4569-cdd9-4a4d-9ef8-6d787b11a75b tempest-CinderUnicodeTest-1746259110 None] Created volume successfully. Jun 30 16:31:55 devstack sudo[114339]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD" returned: 1 in 0.917s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:31:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:55 devstack sudo[114342]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-811cb929-5ce2-4bd2-8710-cb1f6407b85f 1073741824" returned: 0 in 1.048s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-811cb929-5ce2-4bd2-8710-cb1f6407b85f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:56 devstack sudo[114351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-811cb929-5ce2-4bd2-8710-cb1f6407b85f Jun 30 16:31:56 devstack sudo[114351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Flow 'volume_create_manager' (0f7835f4-17f8-40d5-b58a-4a94261242ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc57141-fb24-429f-9a59-27d2745e8796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc57141-fb24-429f-9a59-27d2745e8796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:31:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1758729844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e348dd-5c48-4a1c-a98b-e4e83c6c773e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ba1dec6be7f4beabc1b2920ca6ab41c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:31:56Z,use_quota=True,user_id='538026796b884af8aece3c232385d916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f6d6504-b133-4695-a05c-e769c746a58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f6d6504-b133-4695-a05c-e769c746a58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c50fcd-7d8e-450e-879d-be020d4bffe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c50fcd-7d8e-450e-879d-be020d4bffe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4e348dd-5c48-4a1c-a98b-e4e83c6c773e', 'volume_name': 'volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeef0ed3-1b99-42a9-b1b5-bceb39fb77c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeef0ed3-1b99-42a9-b1b5-bceb39fb77c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c4cf22-f287-49b0-b7c0-2e723a7977c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:56 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Volume b4e348dd-5c48-4a1c-a98b-e4e83c6c773e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e', 'volume_size': 1} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:56 devstack sudo[114351]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-811cb929-5ce2-4bd2-8710-cb1f6407b85f" returned: 0 in 0.850s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.964s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.518s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1073644939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c525a72c-f1da-4359-99b1-2e9a638cd43a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3cc545bbcf408285c8ffc03935b704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:31:48Z,use_quota=True,user_id='ceacf5e55e2f4e098730a9edbcc7c8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Creating volume c525a72c-f1da-4359-99b1-2e9a638cd43a {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:31:56 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c525a72c-f1da-4359-99b1-2e9a638cd43a 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:56 devstack sudo[114354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c525a72c-f1da-4359-99b1-2e9a638cd43a 1073741824 Jun 30 16:31:56 devstack sudo[114354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af75489-72e6-41e3-a66e-e43a2cfd02e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-811cb929-5ce2-4bd2-8710-cb1f6407b85f', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6281cc62-a65f-420c-aa50-d6139caac11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:56 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Volume volume-811cb929-5ce2-4bd2-8710-cb1f6407b85f (811cb929-5ce2-4bd2-8710-cb1f6407b85f): created successfully Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6281cc62-a65f-420c-aa50-d6139caac11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Flow 'volume_create_manager' (39af7c79-4179-4a41-bbf1-3e176eff705f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:31:56 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-96dd85b1-33a0-4485-b99f-14e7d41a72c1 tempest-CreateVolumesFromImageTest-642548269 None] Created volume successfully. Jun 30 16:31:57 devstack sudo[114354]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c525a72c-f1da-4359-99b1-2e9a638cd43a 1073741824" returned: 0 in 0.931s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c525a72c-f1da-4359-99b1-2e9a638cd43a {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:57 devstack sudo[114360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c525a72c-f1da-4359-99b1-2e9a638cd43a Jun 30 16:31:57 devstack sudo[114360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:58 devstack sudo[114360]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c525a72c-f1da-4359-99b1-2e9a638cd43a" returned: 0 in 0.703s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:31:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:31:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.667s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1987863823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b95d57ff-a424-4bb0-8bb6-05cff43d3f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3cc545bbcf408285c8ffc03935b704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:31:49Z,use_quota=True,user_id='ceacf5e55e2f4e098730a9edbcc7c8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:31:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Creating volume b95d57ff-a424-4bb0-8bb6-05cff43d3f19 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:31:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:31:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:31:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:31:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:31:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:31:58 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:31:58 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:31:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b95d57ff-a424-4bb0-8bb6-05cff43d3f19 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d28b09-694c-4854-bef8-0f9614eed4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c525a72c-f1da-4359-99b1-2e9a638cd43a', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:58 devstack sudo[114363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b95d57ff-a424-4bb0-8bb6-05cff43d3f19 1073741824 Jun 30 16:31:58 devstack sudo[114363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:31:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026895e5-c0e8-4539-9c67-35713f83286a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:31:58 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Volume volume-c525a72c-f1da-4359-99b1-2e9a638cd43a (c525a72c-f1da-4359-99b1-2e9a638cd43a): created successfully Jun 30 16:31:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026895e5-c0e8-4539-9c67-35713f83286a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:31:58 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Flow 'volume_create_manager' (eeed50d5-3372-4eae-a470-5e7604ca999f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:31:58 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-b73dd58b-b71d-4341-82b8-b8f028a8dbdc tempest-CreateVolumesFromImageTest-642548269 None] Created volume successfully. Jun 30 16:31:59 devstack sudo[114363]: pam_unix(sudo:session): session closed for user root Jun 30 16:31:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b95d57ff-a424-4bb0-8bb6-05cff43d3f19 1073741824" returned: 0 in 0.934s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:31:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b95d57ff-a424-4bb0-8bb6-05cff43d3f19 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:31:59 devstack sudo[114368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b95d57ff-a424-4bb0-8bb6-05cff43d3f19 Jun 30 16:31:59 devstack sudo[114368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:00 devstack sudo[114368]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b95d57ff-a424-4bb0-8bb6-05cff43d3f19" returned: 0 in 0.833s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:00 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:32:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-08a4fe85-fc1a-4142-9962-4278eef74cde tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.525s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:00 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff357eba-e209-416d-a4fc-9c2f15ba73ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b95d57ff-a424-4bb0-8bb6-05cff43d3f19', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:00 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917c9ba5-f797-4e95-ac1d-80a9384aad20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:00 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-08a4fe85-fc1a-4142-9962-4278eef74cde tempest-CreateVolumesFromSnapshotTest-2056289189 None] Creating offline snapshot af74ce47-57df-4765-a3e9-f59d5b53d15f of volume 3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2 {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:32:00 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Volume volume-b95d57ff-a424-4bb0-8bb6-05cff43d3f19 (b95d57ff-a424-4bb0-8bb6-05cff43d3f19): created successfully Jun 30 16:32:00 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917c9ba5-f797-4e95-ac1d-80a9384aad20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:00 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Flow 'volume_create_manager' (312df5c8-abaa-4e32-ad93-51cdc2751783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:00 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd64c00-4cec-4d29-bc6e-d8bd3ddfcc61]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-08a4fe85-fc1a-4142-9962-4278eef74cde tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:00 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-48fd956e-5391-4642-9dab-58bd1f8be1f1 tempest-CreateVolumesFromImageTest-642548269 None] Created volume successfully. Jun 30 16:32:00 devstack sudo[114371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2 Jun 30 16:32:00 devstack sudo[114371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-31ff7eed-9a8a-430d-96c2-33a5ee0f7e18 tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "cinder-b95d57ff-a424-4bb0-8bb6-05cff43d3f19-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-31ff7eed-9a8a-430d-96c2-33a5ee0f7e18 tempest-CreateVolumesFromImageTest-642548269 None] Lock "cinder-b95d57ff-a424-4bb0-8bb6-05cff43d3f19-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-31ff7eed-9a8a-430d-96c2-33a5ee0f7e18 tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "cinder-quobyte-b95d57ff-a424-4bb0-8bb6-05cff43d3f19" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-31ff7eed-9a8a-430d-96c2-33a5ee0f7e18 tempest-CreateVolumesFromImageTest-642548269 None] Lock "cinder-quobyte-b95d57ff-a424-4bb0-8bb6-05cff43d3f19" acquired by "delete_volume" :: waited 0.031s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:01 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef000ab-5cca-4ea9-ac7e-793a82251afa]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-31ff7eed-9a8a-430d-96c2-33a5ee0f7e18 tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b95d57ff-a424-4bb0-8bb6-05cff43d3f19 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:01 devstack sudo[114373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b95d57ff-a424-4bb0-8bb6-05cff43d3f19 Jun 30 16:32:01 devstack sudo[114373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:01 devstack sudo[114371]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-08a4fe85-fc1a-4142-9962-4278eef74cde tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2" returned: 0 in 0.946s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-08a4fe85-fc1a-4142-9962-4278eef74cde tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.af74ce47-57df-4765-a3e9-f59d5b53d15f 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:01 devstack sudo[114378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.af74ce47-57df-4765-a3e9-f59d5b53d15f 1G Jun 30 16:32:01 devstack sudo[114378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:01 devstack sudo[114373]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-31ff7eed-9a8a-430d-96c2-33a5ee0f7e18 tempest-CreateVolumesFromImageTest-642548269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b95d57ff-a424-4bb0-8bb6-05cff43d3f19" returned: 0 in 0.916s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-31ff7eed-9a8a-430d-96c2-33a5ee0f7e18 tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b95d57ff-a424-4bb0-8bb6-05cff43d3f19 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:02 devstack sudo[114383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b95d57ff-a424-4bb0-8bb6-05cff43d3f19 Jun 30 16:32:02 devstack sudo[114383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:02 devstack sudo[114378]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-08a4fe85-fc1a-4142-9962-4278eef74cde tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.af74ce47-57df-4765-a3e9-f59d5b53d15f 1G" returned: 0 in 1.010s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-08a4fe85-fc1a-4142-9962-4278eef74cde tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.af74ce47-57df-4765-a3e9-f59d5b53d15f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:02 devstack sudo[114388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.af74ce47-57df-4765-a3e9-f59d5b53d15f Jun 30 16:32:02 devstack sudo[114388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:02 devstack sudo[114383]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-31ff7eed-9a8a-430d-96c2-33a5ee0f7e18 tempest-CreateVolumesFromImageTest-642548269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b95d57ff-a424-4bb0-8bb6-05cff43d3f19" returned: 0 in 0.781s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:02 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-31ff7eed-9a8a-430d-96c2-33a5ee0f7e18 tempest-CreateVolumesFromImageTest-642548269 None] Lock "cinder-quobyte-b95d57ff-a424-4bb0-8bb6-05cff43d3f19" released by "delete_volume" :: held 1.770s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:02 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-31ff7eed-9a8a-430d-96c2-33a5ee0f7e18 tempest-CreateVolumesFromImageTest-642548269 None] Created reservations ['7a852d1f-d82a-42c9-98c2-a4f5bfe4d5c0', '5bcb1c63-c5ec-4955-9d7f-e797bc1ab91a', 'd17583b6-9e2f-4f80-99a0-e1802f7c2dfd', 'fe06fe67-a991-40ba-836d-04f5678a4732'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:32:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-31ff7eed-9a8a-430d-96c2-33a5ee0f7e18 tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-31ff7eed-9a8a-430d-96c2-33a5ee0f7e18 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-31ff7eed-9a8a-430d-96c2-33a5ee0f7e18 tempest-CreateVolumesFromImageTest-642548269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:02 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-31ff7eed-9a8a-430d-96c2-33a5ee0f7e18 tempest-CreateVolumesFromImageTest-642548269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-31ff7eed-9a8a-430d-96c2-33a5ee0f7e18 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-31ff7eed-9a8a-430d-96c2-33a5ee0f7e18 tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:03 devstack sudo[114391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:32:03 devstack sudo[114391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:03 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-0b8aa5c6-6fac-4431-88f3-a64a080c81b2 tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "cinder-c525a72c-f1da-4359-99b1-2e9a638cd43a-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:03 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-0b8aa5c6-6fac-4431-88f3-a64a080c81b2 tempest-CreateVolumesFromImageTest-642548269 None] Lock "cinder-c525a72c-f1da-4359-99b1-2e9a638cd43a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:03 devstack sudo[114388]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-08a4fe85-fc1a-4142-9962-4278eef74cde tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.af74ce47-57df-4765-a3e9-f59d5b53d15f" returned: 0 in 0.916s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:03 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-08a4fe85-fc1a-4142-9962-4278eef74cde tempest-CreateVolumesFromSnapshotTest-2056289189 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.af74ce47-57df-4765-a3e9-f59d5b53d15f is being set with open permissions: ugo+rw Jun 30 16:32:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-08a4fe85-fc1a-4142-9962-4278eef74cde tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.af74ce47-57df-4765-a3e9-f59d5b53d15f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:03 devstack sudo[114396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.af74ce47-57df-4765-a3e9-f59d5b53d15f Jun 30 16:32:03 devstack sudo[114396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:03 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-0b8aa5c6-6fac-4431-88f3-a64a080c81b2 tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "cinder-quobyte-c525a72c-f1da-4359-99b1-2e9a638cd43a" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:03 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-0b8aa5c6-6fac-4431-88f3-a64a080c81b2 tempest-CreateVolumesFromImageTest-642548269 None] Lock "cinder-quobyte-c525a72c-f1da-4359-99b1-2e9a638cd43a" acquired by "delete_volume" :: waited 0.033s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:03 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfc5974-ca6c-44f5-afec-af2e43abd5d9]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b8aa5c6-6fac-4431-88f3-a64a080c81b2 tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c525a72c-f1da-4359-99b1-2e9a638cd43a {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:03 devstack sudo[114398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c525a72c-f1da-4359-99b1-2e9a638cd43a Jun 30 16:32:03 devstack sudo[114398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:03 devstack sudo[114391]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-31ff7eed-9a8a-430d-96c2-33a5ee0f7e18 tempest-CreateVolumesFromImageTest-642548269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.915s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:03 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-31ff7eed-9a8a-430d-96c2-33a5ee0f7e18 tempest-CreateVolumesFromImageTest-642548269 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:32:03 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-31ff7eed-9a8a-430d-96c2-33a5ee0f7e18 tempest-CreateVolumesFromImageTest-642548269 None] Deleted volume successfully. Jun 30 16:32:03 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-31ff7eed-9a8a-430d-96c2-33a5ee0f7e18 tempest-CreateVolumesFromImageTest-642548269 None] Lock "cinder-b95d57ff-a424-4bb0-8bb6-05cff43d3f19-delete_volume" released by "delete_volume" :: held 2.975s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:04 devstack sudo[114396]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-08a4fe85-fc1a-4142-9962-4278eef74cde tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.af74ce47-57df-4765-a3e9-f59d5b53d15f" returned: 0 in 0.861s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-08a4fe85-fc1a-4142-9962-4278eef74cde tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:04 devstack sudo[114402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.info Jun 30 16:32:04 devstack sudo[114402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:04 devstack sudo[114398]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b8aa5c6-6fac-4431-88f3-a64a080c81b2 tempest-CreateVolumesFromImageTest-642548269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c525a72c-f1da-4359-99b1-2e9a638cd43a" returned: 0 in 1.070s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b8aa5c6-6fac-4431-88f3-a64a080c81b2 tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c525a72c-f1da-4359-99b1-2e9a638cd43a {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:04 devstack sudo[114407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c525a72c-f1da-4359-99b1-2e9a638cd43a Jun 30 16:32:04 devstack sudo[114407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:05 devstack sudo[114402]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-08a4fe85-fc1a-4142-9962-4278eef74cde tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.info" returned: 0 in 0.780s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:05 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-08a4fe85-fc1a-4142-9962-4278eef74cde tempest-CreateVolumesFromSnapshotTest-2056289189 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.info is being set with open permissions: ugo+rw Jun 30 16:32:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-08a4fe85-fc1a-4142-9962-4278eef74cde tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:05 devstack sudo[114410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.info Jun 30 16:32:05 devstack sudo[114410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:05 devstack sudo[114407]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b8aa5c6-6fac-4431-88f3-a64a080c81b2 tempest-CreateVolumesFromImageTest-642548269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c525a72c-f1da-4359-99b1-2e9a638cd43a" returned: 0 in 0.858s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:05 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-0b8aa5c6-6fac-4431-88f3-a64a080c81b2 tempest-CreateVolumesFromImageTest-642548269 None] Lock "cinder-quobyte-c525a72c-f1da-4359-99b1-2e9a638cd43a" released by "delete_volume" :: held 1.995s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:05 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-0b8aa5c6-6fac-4431-88f3-a64a080c81b2 tempest-CreateVolumesFromImageTest-642548269 None] Created reservations ['be9dff43-6ffc-4f4d-be42-e8b77bc2a371', 'd590600a-3469-44a4-b9b4-8217ef8e73bc', '863b026c-9b26-4933-9cd0-cfd8ff44c26d', 'eb2f9a51-ac80-4389-a786-f6e122c42bda'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:32:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0b8aa5c6-6fac-4431-88f3-a64a080c81b2 tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0b8aa5c6-6fac-4431-88f3-a64a080c81b2 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:05 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-0b8aa5c6-6fac-4431-88f3-a64a080c81b2 tempest-CreateVolumesFromImageTest-642548269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:05 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-0b8aa5c6-6fac-4431-88f3-a64a080c81b2 tempest-CreateVolumesFromImageTest-642548269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-0b8aa5c6-6fac-4431-88f3-a64a080c81b2 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b8aa5c6-6fac-4431-88f3-a64a080c81b2 tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:05 devstack sudo[114414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:32:05 devstack sudo[114414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:06 devstack sudo[114410]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-08a4fe85-fc1a-4142-9962-4278eef74cde tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.info" returned: 0 in 0.996s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-08a4fe85-fc1a-4142-9962-4278eef74cde tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.660s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.369s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ad37dc-ccbc-4694-8f12-ea8f049b714c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d77e58c97d4b66971dfc1440325dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:31:51Z,use_quota=True,user_id='b88ed803e02f41df87544027f0d20327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6c0861a-fd6f-48e3-9b7a-78fd96c26d5c),volume_type_id=f6c0861a-fd6f-48e3-9b7a-78fd96c26d5c)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:32:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Creating volume 41ad37dc-ccbc-4694-8f12-ea8f049b714c {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:32:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:32:06 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:32:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:06 devstack sudo[114417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c 1073741824 Jun 30 16:32:06 devstack sudo[114417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:06 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-08a4fe85-fc1a-4142-9962-4278eef74cde tempest-CreateVolumesFromSnapshotTest-2056289189 None] Create snapshot completed successfully Jun 30 16:32:06 devstack sudo[114414]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-0b8aa5c6-6fac-4431-88f3-a64a080c81b2 tempest-CreateVolumesFromImageTest-642548269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.926s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:06 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-0b8aa5c6-6fac-4431-88f3-a64a080c81b2 tempest-CreateVolumesFromImageTest-642548269 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:32:06 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-0b8aa5c6-6fac-4431-88f3-a64a080c81b2 tempest-CreateVolumesFromImageTest-642548269 None] Deleted volume successfully. Jun 30 16:32:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-0b8aa5c6-6fac-4431-88f3-a64a080c81b2 tempest-CreateVolumesFromImageTest-642548269 None] Lock "cinder-c525a72c-f1da-4359-99b1-2e9a638cd43a-delete_volume" released by "delete_volume" :: held 3.314s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2686c83a-cc4d-496e-8a5e-a64101e3f0f2 tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "cinder-811cb929-5ce2-4bd2-8710-cb1f6407b85f-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2686c83a-cc4d-496e-8a5e-a64101e3f0f2 tempest-CreateVolumesFromImageTest-642548269 None] Lock "cinder-811cb929-5ce2-4bd2-8710-cb1f6407b85f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2686c83a-cc4d-496e-8a5e-a64101e3f0f2 tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "cinder-quobyte-811cb929-5ce2-4bd2-8710-cb1f6407b85f" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2686c83a-cc4d-496e-8a5e-a64101e3f0f2 tempest-CreateVolumesFromImageTest-642548269 None] Lock "cinder-quobyte-811cb929-5ce2-4bd2-8710-cb1f6407b85f" acquired by "delete_volume" :: waited 0.022s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:06 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bd5635-eee9-4f22-8cfe-7308e944bc92]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2686c83a-cc4d-496e-8a5e-a64101e3f0f2 tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-811cb929-5ce2-4bd2-8710-cb1f6407b85f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:07 devstack sudo[114423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-811cb929-5ce2-4bd2-8710-cb1f6407b85f Jun 30 16:32:07 devstack sudo[114423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:07 devstack sudo[114417]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c 1073741824" returned: 0 in 1.177s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:07 devstack sudo[114427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c Jun 30 16:32:07 devstack sudo[114427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:07 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:32:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Flow 'volume_create_manager' (7dbc8af0-0596-4418-b4fa-f901243296ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f919b0c0-86ae-4b57-84cd-8680c042c92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f919b0c0-86ae-4b57-84cd-8680c042c92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-616171449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87a283db-04d8-46c2-bc23-7b1fd16f2b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7edaae5c12c64d078ebf0459ccf69831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:07Z,use_quota=True,user_id='f62d440d987849449c7af677116aa0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501ad3b0-5c09-4873-b2f3-ce20d3abd65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501ad3b0-5c09-4873-b2f3-ce20d3abd65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6785748-974c-40e7-ba2c-db498fa84a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6785748-974c-40e7-ba2c-db498fa84a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87a283db-04d8-46c2-bc23-7b1fd16f2b11', 'volume_name': 'volume-87a283db-04d8-46c2-bc23-7b1fd16f2b11', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb6fa55-c357-4b9b-976a-3801666057d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb6fa55-c357-4b9b-976a-3801666057d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:07 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005feafd-8ae3-4330-8b23-79c9e4c605e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:07 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Volume 87a283db-04d8-46c2-bc23-7b1fd16f2b11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87a283db-04d8-46c2-bc23-7b1fd16f2b11', 'volume_size': 1} Jun 30 16:32:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Flow 'volume_create_manager' (29348f3a-2bb6-411d-b6e8-bd5637eafde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fae901c-3283-428b-857a-eac7de55a06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fae901c-3283-428b-857a-eac7de55a06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-923402751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7edaae5c12c64d078ebf0459ccf69831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:08Z,use_quota=True,user_id='f62d440d987849449c7af677116aa0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79fc9245-8ec9-46c4-b05d-48760a6fb71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79fc9245-8ec9-46c4-b05d-48760a6fb71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:08 devstack sudo[114423]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2b329e-6825-4461-89f1-b4dc341cc075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef2b329e-6825-4461-89f1-b4dc341cc075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe', 'volume_name': 'volume-ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e9b547-f97b-43d7-94e5-faaa37c40b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e9b547-f97b-43d7-94e5-faaa37c40b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f416c1b-dd64-4897-8729-4a29187fa3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:08 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Volume ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe', 'volume_size': 1} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2686c83a-cc4d-496e-8a5e-a64101e3f0f2 tempest-CreateVolumesFromImageTest-642548269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-811cb929-5ce2-4bd2-8710-cb1f6407b85f" returned: 0 in 1.507s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2686c83a-cc4d-496e-8a5e-a64101e3f0f2 tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-811cb929-5ce2-4bd2-8710-cb1f6407b85f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:08 devstack sudo[114427]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c" returned: 0 in 1.097s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] <== create_volume: return (2358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.363s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.874s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:31:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1758729844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e348dd-5c48-4a1c-a98b-e4e83c6c773e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ba1dec6be7f4beabc1b2920ca6ab41c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:31:56Z,use_quota=True,user_id='538026796b884af8aece3c232385d916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Creating volume b4e348dd-5c48-4a1c-a98b-e4e83c6c773e {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:32:08 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:08 devstack sudo[114436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-811cb929-5ce2-4bd2-8710-cb1f6407b85f Jun 30 16:32:08 devstack sudo[114436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:08 devstack sudo[114437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e 1073741824 Jun 30 16:32:08 devstack sudo[114437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Attempting download of dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab ((None, [{'url': 'file:///opt/stack/data/glance/images/dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab', 'metadata': {}}])) to volume 41ad37dc-ccbc-4694-8f12-ea8f049b714c. {{(pid=93781) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d620f7-261f-4bad-8309-82f95121fc71]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_nt9kzp7s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:32:08 devstack sudo[114440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_nt9kzp7s Jun 30 16:32:08 devstack sudo[114440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Flow 'volume_create_manager' (9f96cbd9-8976-44f5-b528-423d5ae217d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c916297-8e47-4a06-a057-8fd851e08030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c916297-8e47-4a06-a057-8fd851e08030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-414962644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f95a3f9c-c61d-4085-a6da-07e4a6bb752f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7edaae5c12c64d078ebf0459ccf69831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:09Z,use_quota=True,user_id='f62d440d987849449c7af677116aa0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:08 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdba2a8-179a-4623-8763-233f7ccc82da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdba2a8-179a-4623-8763-233f7ccc82da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a502fa-428e-4735-b743-c394e3ce3628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a502fa-428e-4735-b743-c394e3ce3628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f95a3f9c-c61d-4085-a6da-07e4a6bb752f', 'volume_name': 'volume-f95a3f9c-c61d-4085-a6da-07e4a6bb752f', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee4f9d6-d3f7-4f58-bf1d-c7467c80747c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee4f9d6-d3f7-4f58-bf1d-c7467c80747c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e626b0e8-26fc-415b-a0ea-cac0bf058645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:09 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Volume f95a3f9c-c61d-4085-a6da-07e4a6bb752f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f95a3f9c-c61d-4085-a6da-07e4a6bb752f', 'volume_size': 1} Jun 30 16:32:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:09 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:32:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Flow 'volume_create_manager' (0ba72936-4c79-41e5-9a0e-e48dd3642c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a12ca60-6f99-423b-9cc9-2099bde57f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:09 devstack sudo[114436]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2686c83a-cc4d-496e-8a5e-a64101e3f0f2 tempest-CreateVolumesFromImageTest-642548269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-811cb929-5ce2-4bd2-8710-cb1f6407b85f" returned: 0 in 1.309s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a12ca60-6f99-423b-9cc9-2099bde57f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-506266168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837971fc-cc6c-4ec4-a49b-96cc76f74c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7edaae5c12c64d078ebf0459ccf69831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:09Z,use_quota=True,user_id='f62d440d987849449c7af677116aa0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f77635c-8407-46a1-a99b-bab4025c6630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f77635c-8407-46a1-a99b-bab4025c6630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfe3567-e7a9-4344-b285-ac95f64de978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfe3567-e7a9-4344-b285-ac95f64de978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '837971fc-cc6c-4ec4-a49b-96cc76f74c55', 'volume_name': 'volume-837971fc-cc6c-4ec4-a49b-96cc76f74c55', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519f7f53-7445-431b-85f0-b32054e808e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519f7f53-7445-431b-85f0-b32054e808e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:09 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64823aa3-af4f-47db-8d1b-620b06feff7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:09 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Volume 837971fc-cc6c-4ec4-a49b-96cc76f74c55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-837971fc-cc6c-4ec4-a49b-96cc76f74c55', 'volume_size': 1} Jun 30 16:32:09 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:09 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2686c83a-cc4d-496e-8a5e-a64101e3f0f2 tempest-CreateVolumesFromImageTest-642548269 None] Lock "cinder-quobyte-811cb929-5ce2-4bd2-8710-cb1f6407b85f" released by "delete_volume" :: held 2.960s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:09 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-2686c83a-cc4d-496e-8a5e-a64101e3f0f2 tempest-CreateVolumesFromImageTest-642548269 None] Created reservations ['8981c409-b1fd-4a92-b301-2762ecbba175', 'b5a47e34-783d-4666-9af0-8695d60533e8', '8d13897e-647a-470d-8222-13c9c1ffa88b', 'd439cbbe-be50-4f72-abf3-cf6dcac3ab7c'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2686c83a-cc4d-496e-8a5e-a64101e3f0f2 tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2686c83a-cc4d-496e-8a5e-a64101e3f0f2 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-2686c83a-cc4d-496e-8a5e-a64101e3f0f2 tempest-CreateVolumesFromImageTest-642548269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:10 devstack sudo[114440]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-2686c83a-cc4d-496e-8a5e-a64101e3f0f2 tempest-CreateVolumesFromImageTest-642548269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2686c83a-cc4d-496e-8a5e-a64101e3f0f2 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2686c83a-cc4d-496e-8a5e-a64101e3f0f2 tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_nt9kzp7s" returned: 0 in 1.458s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_nt9kzp7s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:10 devstack sudo[114449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:32:10 devstack sudo[114449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:10 devstack sudo[114437]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e 1073741824" returned: 0 in 1.744s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:10 devstack sudo[114452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e Jun 30 16:32:10 devstack sudo[114452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:10 devstack sudo[114450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_nt9kzp7s Jun 30 16:32:10 devstack sudo[114450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Flow 'volume_create_manager' (55bc7d64-6d88-4433-a735-20b2a86126d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d6a4605-759e-4ce4-aeb6-31769f48e072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d6a4605-759e-4ce4-aeb6-31769f48e072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1698728940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a69982-36dc-4e28-90c9-7006a58640ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7edaae5c12c64d078ebf0459ccf69831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:10Z,use_quota=True,user_id='f62d440d987849449c7af677116aa0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff7f1de-9883-44f6-baec-e990d89977d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff7f1de-9883-44f6-baec-e990d89977d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa5ce7b-ae38-4fd9-b272-f9e27a991052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa5ce7b-ae38-4fd9-b272-f9e27a991052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2a69982-36dc-4e28-90c9-7006a58640ff', 'volume_name': 'volume-b2a69982-36dc-4e28-90c9-7006a58640ff', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8943feee-e14b-4dc1-846a-3aa80141b907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8943feee-e14b-4dc1-846a-3aa80141b907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ae9822-6e2b-4710-89a0-4f2a0d594065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:10 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Volume b2a69982-36dc-4e28-90c9-7006a58640ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2a69982-36dc-4e28-90c9-7006a58640ff', 'volume_size': 1} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-98bcb9a5-2a15-40e3-b54b-95e4444e5a25 tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "cinder-a6e735b7-0676-4336-be85-4b1ffc4bed1b-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-98bcb9a5-2a15-40e3-b54b-95e4444e5a25 tempest-CreateVolumesFromImageTest-642548269 None] Lock "cinder-a6e735b7-0676-4336-be85-4b1ffc4bed1b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-98bcb9a5-2a15-40e3-b54b-95e4444e5a25 tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "cinder-quobyte-a6e735b7-0676-4336-be85-4b1ffc4bed1b" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-98bcb9a5-2a15-40e3-b54b-95e4444e5a25 tempest-CreateVolumesFromImageTest-642548269 None] Lock "cinder-quobyte-a6e735b7-0676-4336-be85-4b1ffc4bed1b" acquired by "delete_volume" :: waited 0.024s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[0414b337-06ef-4b5f-a9e7-8721c60bf241]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:10 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-98bcb9a5-2a15-40e3-b54b-95e4444e5a25 tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6e735b7-0676-4336-be85-4b1ffc4bed1b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:10 devstack sudo[114455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6e735b7-0676-4336-be85-4b1ffc4bed1b Jun 30 16:32:10 devstack sudo[114455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:11 devstack sudo[114449]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2686c83a-cc4d-496e-8a5e-a64101e3f0f2 tempest-CreateVolumesFromImageTest-642548269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.036s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-2686c83a-cc4d-496e-8a5e-a64101e3f0f2 tempest-CreateVolumesFromImageTest-642548269 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:32:11 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-2686c83a-cc4d-496e-8a5e-a64101e3f0f2 tempest-CreateVolumesFromImageTest-642548269 None] Deleted volume successfully. Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2686c83a-cc4d-496e-8a5e-a64101e3f0f2 tempest-CreateVolumesFromImageTest-642548269 None] Lock "cinder-811cb929-5ce2-4bd2-8710-cb1f6407b85f-delete_volume" released by "delete_volume" :: held 4.423s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:11 devstack sudo[114452]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e" returned: 0 in 1.051s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] <== create_volume: return (2866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.871s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.563s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-616171449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87a283db-04d8-46c2-bc23-7b1fd16f2b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7edaae5c12c64d078ebf0459ccf69831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:07Z,use_quota=True,user_id='f62d440d987849449c7af677116aa0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Creating volume 87a283db-04d8-46c2-bc23-7b1fd16f2b11 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:32:11 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-87a283db-04d8-46c2-bc23-7b1fd16f2b11 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c4cf22-f287-49b0-b7c0-2e723a7977c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1864eaa-107d-4ca3-8542-e4ac17ea17f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:11 devstack sudo[114461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-87a283db-04d8-46c2-bc23-7b1fd16f2b11 1073741824 Jun 30 16:32:11 devstack sudo[114461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:11 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Volume volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e (b4e348dd-5c48-4a1c-a98b-e4e83c6c773e): created successfully Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1864eaa-107d-4ca3-8542-e4ac17ea17f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Flow 'volume_create_manager' (0f7835f4-17f8-40d5-b58a-4a94261242ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:11 devstack sudo[114450]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_nt9kzp7s" returned: 1 in 1.301s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_nt9kzp7s' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[21433366-41db-4238-bcc7-6a25f7ce1a46]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:11 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-a5c55c9c-39fd-4a09-b9b8-1507dbfc63d5 tempest-CinderUnicodeTest-1746259110 None] Created volume successfully. Jun 30 16:32:11 devstack sudo[114463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD Jun 30 16:32:11 devstack sudo[114463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:11 devstack sudo[114455]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-98bcb9a5-2a15-40e3-b54b-95e4444e5a25 tempest-CreateVolumesFromImageTest-642548269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6e735b7-0676-4336-be85-4b1ffc4bed1b" returned: 0 in 1.187s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:11 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-98bcb9a5-2a15-40e3-b54b-95e4444e5a25 tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6e735b7-0676-4336-be85-4b1ffc4bed1b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:11 devstack sudo[114468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6e735b7-0676-4336-be85-4b1ffc4bed1b Jun 30 16:32:11 devstack sudo[114468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c9791d5b-53a4-4826-9094-43c028f1c1d7 tempest-CinderUnicodeTest-1746259110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:12 devstack sudo[114461]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-87a283db-04d8-46c2-bc23-7b1fd16f2b11 1073741824" returned: 0 in 1.204s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-87a283db-04d8-46c2-bc23-7b1fd16f2b11 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:12 devstack sudo[114495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-87a283db-04d8-46c2-bc23-7b1fd16f2b11 Jun 30 16:32:12 devstack sudo[114495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:12 devstack sudo[114463]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD" returned: 0 in 1.208s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:12 devstack sudo[114513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD Jun 30 16:32:12 devstack sudo[114513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:12 devstack sudo[114468]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:12 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-98bcb9a5-2a15-40e3-b54b-95e4444e5a25 tempest-CreateVolumesFromImageTest-642548269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-a6e735b7-0676-4336-be85-4b1ffc4bed1b" returned: 0 in 1.026s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:12 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-98bcb9a5-2a15-40e3-b54b-95e4444e5a25 tempest-CreateVolumesFromImageTest-642548269 None] Lock "cinder-quobyte-a6e735b7-0676-4336-be85-4b1ffc4bed1b" released by "delete_volume" :: held 2.303s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:12 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-98bcb9a5-2a15-40e3-b54b-95e4444e5a25 tempest-CreateVolumesFromImageTest-642548269 None] Created reservations ['f1f67d4a-0530-49f0-bdad-374991466fba', '500f71c8-4714-4ef4-bdd8-7d9b5e50ce15', '2a2e14a7-4457-4095-969d-815ddf611707', '2440ae57-1f96-4d31-8ac7-6ff1f8265280'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-98bcb9a5-2a15-40e3-b54b-95e4444e5a25 tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-98bcb9a5-2a15-40e3-b54b-95e4444e5a25 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-98bcb9a5-2a15-40e3-b54b-95e4444e5a25 tempest-CreateVolumesFromImageTest-642548269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-98bcb9a5-2a15-40e3-b54b-95e4444e5a25 tempest-CreateVolumesFromImageTest-642548269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-98bcb9a5-2a15-40e3-b54b-95e4444e5a25 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-98bcb9a5-2a15-40e3-b54b-95e4444e5a25 tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:13 devstack sudo[114517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:32:13 devstack sudo[114517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:13 devstack sudo[114495]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-87a283db-04d8-46c2-bc23-7b1fd16f2b11" returned: 0 in 0.999s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] <== create_volume: return (2259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.261s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.170s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-923402751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7edaae5c12c64d078ebf0459ccf69831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:08Z,use_quota=True,user_id='f62d440d987849449c7af677116aa0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Creating volume ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:32:13 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:13 devstack sudo[114513]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD" returned: 1 in 0.987s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab was raw, converting to raw {{(pid=93781) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:13 devstack sudo[114523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe 1073741824 Jun 30 16:32:13 devstack sudo[114523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005feafd-8ae3-4330-8b23-79c9e4c605e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87a283db-04d8-46c2-bc23-7b1fd16f2b11', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:13 devstack sudo[114525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c Jun 30 16:32:13 devstack sudo[114525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51059f4c-0f1a-4d46-9337-e060d0453dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:13 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Volume volume-87a283db-04d8-46c2-bc23-7b1fd16f2b11 (87a283db-04d8-46c2-bc23-7b1fd16f2b11): created successfully Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51059f4c-0f1a-4d46-9337-e060d0453dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Flow 'volume_create_manager' (7dbc8af0-0596-4418-b4fa-f901243296ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:13 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-a08ad825-872a-413e-ae15-f13fb59de155 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Created volume successfully. Jun 30 16:32:13 devstack sudo[114517]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-98bcb9a5-2a15-40e3-b54b-95e4444e5a25 tempest-CreateVolumesFromImageTest-642548269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.769s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-98bcb9a5-2a15-40e3-b54b-95e4444e5a25 tempest-CreateVolumesFromImageTest-642548269 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:32:13 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-98bcb9a5-2a15-40e3-b54b-95e4444e5a25 tempest-CreateVolumesFromImageTest-642548269 None] Deleted volume successfully. Jun 30 16:32:13 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-98bcb9a5-2a15-40e3-b54b-95e4444e5a25 tempest-CreateVolumesFromImageTest-642548269 None] Lock "cinder-a6e735b7-0676-4336-be85-4b1ffc4bed1b-delete_volume" released by "delete_volume" :: held 3.480s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:14 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6dfc5ed6-1254-46ee-b5a3-3a353555f024 tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "cinder-199d3322-5ab3-4f2a-b39f-628386c2cc4f-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:14 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6dfc5ed6-1254-46ee-b5a3-3a353555f024 tempest-CreateVolumesFromImageTest-642548269 None] Lock "cinder-199d3322-5ab3-4f2a-b39f-628386c2cc4f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:14 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6dfc5ed6-1254-46ee-b5a3-3a353555f024 tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "cinder-quobyte-199d3322-5ab3-4f2a-b39f-628386c2cc4f" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:14 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6dfc5ed6-1254-46ee-b5a3-3a353555f024 tempest-CreateVolumesFromImageTest-642548269 None] Lock "cinder-quobyte-199d3322-5ab3-4f2a-b39f-628386c2cc4f" acquired by "delete_volume" :: waited 0.015s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:14 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b8d253-d95b-42fb-a0a1-63028b516ef5]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6dfc5ed6-1254-46ee-b5a3-3a353555f024 tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-199d3322-5ab3-4f2a-b39f-628386c2cc4f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:14 devstack sudo[114534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-199d3322-5ab3-4f2a-b39f-628386c2cc4f Jun 30 16:32:14 devstack sudo[114534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:14 devstack sudo[114525]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c" returned: 0 in 1.004s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:14 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab_qxfps7modevstack@QuobyteHD, size 0.00 MB, duration 1.01 sec, destination /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:32:14 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Converted 0.00 MB image at 0.00 MB/s Jun 30 16:32:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:14 devstack sudo[114537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c 1G Jun 30 16:32:14 devstack sudo[114537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:14 devstack sudo[114523]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe 1073741824" returned: 0 in 1.099s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:14 devstack sudo[114539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe Jun 30 16:32:14 devstack sudo[114539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:15 devstack sudo[114534]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6dfc5ed6-1254-46ee-b5a3-3a353555f024 tempest-CreateVolumesFromImageTest-642548269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-199d3322-5ab3-4f2a-b39f-628386c2cc4f" returned: 0 in 1.056s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6dfc5ed6-1254-46ee-b5a3-3a353555f024 tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-199d3322-5ab3-4f2a-b39f-628386c2cc4f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:15 devstack sudo[114539]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe" returned: 0 in 0.711s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:32:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.347s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-414962644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f95a3f9c-c61d-4085-a6da-07e4a6bb752f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7edaae5c12c64d078ebf0459ccf69831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:09Z,use_quota=True,user_id='f62d440d987849449c7af677116aa0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:32:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Creating volume f95a3f9c-c61d-4085-a6da-07e4a6bb752f {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:32:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:15 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:32:15 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:32:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f95a3f9c-c61d-4085-a6da-07e4a6bb752f 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:15 devstack sudo[114548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-199d3322-5ab3-4f2a-b39f-628386c2cc4f Jun 30 16:32:15 devstack sudo[114548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f416c1b-dd64-4897-8729-4a29187fa3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:15 devstack sudo[114550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f95a3f9c-c61d-4085-a6da-07e4a6bb752f 1073741824 Jun 30 16:32:15 devstack sudo[114550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e5e218-1bcb-4944-a644-f19b6e59de69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:15 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Volume volume-ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe (ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe): created successfully Jun 30 16:32:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e5e218-1bcb-4944-a644-f19b6e59de69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:15 devstack sudo[114537]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:15 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Flow 'volume_create_manager' (29348f3a-2bb6-411d-b6e8-bd5637eafde6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c 1G" returned: 0 in 0.907s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:15 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-87794ce5-02dd-48d5-adab-7346b2523d51 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Created volume successfully. Jun 30 16:32:15 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59a791b-4e9e-41ab-b326-965e2b721533]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:15 devstack sudo[114552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c Jun 30 16:32:15 devstack sudo[114552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:16 devstack sudo[114548]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6dfc5ed6-1254-46ee-b5a3-3a353555f024 tempest-CreateVolumesFromImageTest-642548269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-199d3322-5ab3-4f2a-b39f-628386c2cc4f" returned: 0 in 0.908s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:16 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6dfc5ed6-1254-46ee-b5a3-3a353555f024 tempest-CreateVolumesFromImageTest-642548269 None] Lock "cinder-quobyte-199d3322-5ab3-4f2a-b39f-628386c2cc4f" released by "delete_volume" :: held 2.032s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:16 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-6dfc5ed6-1254-46ee-b5a3-3a353555f024 tempest-CreateVolumesFromImageTest-642548269 None] Created reservations ['6799f446-d3e9-44a0-912c-5f55edf8c89e', 'b7217a06-888d-4f54-a2f7-4c238d2f5171', '14d733fb-7beb-4986-9c4b-993a14648725', '8261746b-6924-4a14-849e-e6f6c11ed34a'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:32:16 devstack sudo[114550]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f95a3f9c-c61d-4085-a6da-07e4a6bb752f 1073741824" returned: 0 in 1.079s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:16 devstack sudo[114552]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f95a3f9c-c61d-4085-a6da-07e4a6bb752f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c" returned: 0 in 1.012s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:16 devstack sudo[114560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f95a3f9c-c61d-4085-a6da-07e4a6bb752f Jun 30 16:32:16 devstack sudo[114560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6dfc5ed6-1254-46ee-b5a3-3a353555f024 tempest-CreateVolumesFromImageTest-642548269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6dfc5ed6-1254-46ee-b5a3-3a353555f024 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:16 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6dfc5ed6-1254-46ee-b5a3-3a353555f024 tempest-CreateVolumesFromImageTest-642548269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:16 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-6dfc5ed6-1254-46ee-b5a3-3a353555f024 tempest-CreateVolumesFromImageTest-642548269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-6dfc5ed6-1254-46ee-b5a3-3a353555f024 tempest-CreateVolumesFromImageTest-642548269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6dfc5ed6-1254-46ee-b5a3-3a353555f024 tempest-CreateVolumesFromImageTest-642548269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:16 devstack sudo[114563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:32:16 devstack sudo[114563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:16 devstack sudo[114561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c Jun 30 16:32:16 devstack sudo[114561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:17 devstack sudo[114560]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f95a3f9c-c61d-4085-a6da-07e4a6bb752f" returned: 0 in 0.725s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.528s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-506266168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837971fc-cc6c-4ec4-a49b-96cc76f74c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7edaae5c12c64d078ebf0459ccf69831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:09Z,use_quota=True,user_id='f62d440d987849449c7af677116aa0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Creating volume 837971fc-cc6c-4ec4-a49b-96cc76f74c55 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:32:17 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-837971fc-cc6c-4ec4-a49b-96cc76f74c55 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e626b0e8-26fc-415b-a0ea-cac0bf058645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f95a3f9c-c61d-4085-a6da-07e4a6bb752f', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd4ab43-0d4f-4e3e-8934-2c8cde37d9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:17 devstack sudo[114569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-837971fc-cc6c-4ec4-a49b-96cc76f74c55 1073741824 Jun 30 16:32:17 devstack sudo[114569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:17 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Volume volume-f95a3f9c-c61d-4085-a6da-07e4a6bb752f (f95a3f9c-c61d-4085-a6da-07e4a6bb752f): created successfully Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd4ab43-0d4f-4e3e-8934-2c8cde37d9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Flow 'volume_create_manager' (9f96cbd9-8976-44f5-b528-423d5ae217d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:17 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-52f2e442-3735-4722-bb79-b0960c1d9a7b tempest-CreateVolumesFromSnapshotTest-2056289189 None] Created volume successfully. Jun 30 16:32:17 devstack sudo[114563]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-6dfc5ed6-1254-46ee-b5a3-3a353555f024 tempest-CreateVolumesFromImageTest-642548269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.830s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-6dfc5ed6-1254-46ee-b5a3-3a353555f024 tempest-CreateVolumesFromImageTest-642548269 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:32:17 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-6dfc5ed6-1254-46ee-b5a3-3a353555f024 tempest-CreateVolumesFromImageTest-642548269 None] Deleted volume successfully. Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-6dfc5ed6-1254-46ee-b5a3-3a353555f024 tempest-CreateVolumesFromImageTest-642548269 None] Lock "cinder-199d3322-5ab3-4f2a-b39f-628386c2cc4f-delete_volume" released by "delete_volume" :: held 3.297s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:17 devstack sudo[114561]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c" returned: 1 in 1.187s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Downloaded image dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab ((None, [{'url': 'file:///opt/stack/data/glance/images/dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab', 'metadata': {}}])) to volume 41ad37dc-ccbc-4694-8f12-ea8f049b714c successfully. {{(pid=93781) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Temporary image dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab for user b88ed803e02f41df87544027f0d20327 is deleted. {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Marking volume 41ad37dc-ccbc-4694-8f12-ea8f049b714c as bootable. {{(pid=93781) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Copying metadata from image dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab to 41ad37dc-ccbc-4694-8f12-ea8f049b714c. {{(pid=93781) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Creating volume glance metadata for volume 41ad37dc-ccbc-4694-8f12-ea8f049b714c backed by image dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7fd555187320aeefe509d14d4cdf4895', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93781) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a666ff-1e3d-424c-b1a0-c0da9b7ad4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c', 'volume_size': 1, 'image_id': 'dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7fd555187320aeefe509d14d4cdf4895', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '78d77e58c97d4b66971dfc1440325dd7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '85e74444009497a8518fe5320fdcddefb72fb7bd022f18862be1563189e432c2be5b7bc0479f4f663eae9efca4952618a7c90144ec68859c624911977434bc13', 'id': 'dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab', 'created_at': datetime.datetime(2026, 6, 30, 14, 31, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 14, 31, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbfb2126-7f8d-4e3c-b9c5-e9620d04ceab/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f755e750-ca43-4001-b356-5bd5612292fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:17 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Volume volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c (41ad37dc-ccbc-4694-8f12-ea8f049b714c): created successfully Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f755e750-ca43-4001-b356-5bd5612292fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:17 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Flow 'volume_create_manager' (6a62ebb2-94ef-4aa7-82a7-7df56fa7a23d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:18 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-f29eb4f1-adaf-419e-bff0-9d507d2aeac9 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Created volume successfully. Jun 30 16:32:18 devstack sudo[114569]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-837971fc-cc6c-4ec4-a49b-96cc76f74c55 1073741824" returned: 0 in 1.241s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-837971fc-cc6c-4ec4-a49b-96cc76f74c55 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:18 devstack sudo[114578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-837971fc-cc6c-4ec4-a49b-96cc76f74c55 Jun 30 16:32:18 devstack sudo[114578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:18 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-27ee30ca-6829-49c3-81ac-b7e2e5e42e55 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Acquiring lock "cinder-41ad37dc-ccbc-4694-8f12-ea8f049b714c-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:18 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-27ee30ca-6829-49c3-81ac-b7e2e5e42e55 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Lock "cinder-41ad37dc-ccbc-4694-8f12-ea8f049b714c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:18 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-27ee30ca-6829-49c3-81ac-b7e2e5e42e55 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Acquiring lock "cinder-quobyte-41ad37dc-ccbc-4694-8f12-ea8f049b714c" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:18 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-27ee30ca-6829-49c3-81ac-b7e2e5e42e55 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Lock "cinder-quobyte-41ad37dc-ccbc-4694-8f12-ea8f049b714c" acquired by "delete_volume" :: waited 0.023s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:18 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75ec53c-55d5-42d9-b685-c902481a3c72]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-27ee30ca-6829-49c3-81ac-b7e2e5e42e55 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:19 devstack sudo[114580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c Jun 30 16:32:19 devstack sudo[114580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:19 devstack sudo[114578]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-837971fc-cc6c-4ec4-a49b-96cc76f74c55" returned: 0 in 0.965s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] <== create_volume: return (2284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:32:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.289s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.195s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1698728940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a69982-36dc-4e28-90c9-7006a58640ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7edaae5c12c64d078ebf0459ccf69831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:10Z,use_quota=True,user_id='f62d440d987849449c7af677116aa0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:32:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Creating volume b2a69982-36dc-4e28-90c9-7006a58640ff {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:32:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:19 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:32:19 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:32:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b2a69982-36dc-4e28-90c9-7006a58640ff 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:19 devstack sudo[114584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b2a69982-36dc-4e28-90c9-7006a58640ff 1073741824 Jun 30 16:32:19 devstack sudo[114584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64823aa3-af4f-47db-8d1b-620b06feff7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-837971fc-cc6c-4ec4-a49b-96cc76f74c55', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (631a2c08-355b-4376-9b4b-b213a567515c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:19 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Volume volume-837971fc-cc6c-4ec4-a49b-96cc76f74c55 (837971fc-cc6c-4ec4-a49b-96cc76f74c55): created successfully Jun 30 16:32:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (631a2c08-355b-4376-9b4b-b213a567515c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:19 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Flow 'volume_create_manager' (0ba72936-4c79-41e5-9a0e-e48dd3642c97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:19 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-5370940c-f6a6-4d12-a7f9-b396580a85b7 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Created volume successfully. Jun 30 16:32:19 devstack sudo[114580]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-27ee30ca-6829-49c3-81ac-b7e2e5e42e55 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c" returned: 0 in 1.026s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-27ee30ca-6829-49c3-81ac-b7e2e5e42e55 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:20 devstack sudo[114588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c Jun 30 16:32:20 devstack sudo[114588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:20 devstack sudo[114584]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b2a69982-36dc-4e28-90c9-7006a58640ff 1073741824" returned: 0 in 1.130s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b2a69982-36dc-4e28-90c9-7006a58640ff {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:20 devstack sudo[114596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b2a69982-36dc-4e28-90c9-7006a58640ff Jun 30 16:32:20 devstack sudo[114596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:20 devstack sudo[114588]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-27ee30ca-6829-49c3-81ac-b7e2e5e42e55 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c" returned: 1 in 0.964s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-27ee30ca-6829-49c3-81ac-b7e2e5e42e55 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:32:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-27ee30ca-6829-49c3-81ac-b7e2e5e42e55 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:21 devstack sudo[114598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c Jun 30 16:32:21 devstack sudo[114598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:21 devstack sudo[114596]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b2a69982-36dc-4e28-90c9-7006a58640ff" returned: 0 in 0.821s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] <== create_volume: return (2018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:32:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c9791d5b-53a4-4826-9094-43c028f1c1d7 tempest-CinderUnicodeTest-1746259110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.639s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-c9791d5b-53a4-4826-9094-43c028f1c1d7 tempest-CinderUnicodeTest-1746259110 None] Creating offline snapshot 16051bed-1eb4-4b25-98b5-e2d0ac21ddb7 of volume b4e348dd-5c48-4a1c-a98b-e4e83c6c773e {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:32:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ae9822-6e2b-4710-89a0-4f2a0d594065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a69982-36dc-4e28-90c9-7006a58640ff', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68292e9-f0f5-4adf-8053-cb394346ef69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:21 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[c825ea72-4a78-45db-b67b-2a048d8cbe57]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c9791d5b-53a4-4826-9094-43c028f1c1d7 tempest-CinderUnicodeTest-1746259110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:21 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Volume volume-b2a69982-36dc-4e28-90c9-7006a58640ff (b2a69982-36dc-4e28-90c9-7006a58640ff): created successfully Jun 30 16:32:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68292e9-f0f5-4adf-8053-cb394346ef69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Flow 'volume_create_manager' (55bc7d64-6d88-4433-a735-20b2a86126d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:21 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-49e253c4-e2a0-4b4b-9d17-14010964d700 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Created volume successfully. Jun 30 16:32:21 devstack sudo[114602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e Jun 30 16:32:21 devstack sudo[114602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:21 devstack sudo[114598]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-27ee30ca-6829-49c3-81ac-b7e2e5e42e55 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-41ad37dc-ccbc-4694-8f12-ea8f049b714c" returned: 0 in 0.905s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:21 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-27ee30ca-6829-49c3-81ac-b7e2e5e42e55 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Lock "cinder-quobyte-41ad37dc-ccbc-4694-8f12-ea8f049b714c" released by "delete_volume" :: held 2.981s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:21 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-27ee30ca-6829-49c3-81ac-b7e2e5e42e55 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Created reservations ['2b8d4859-05e5-48e0-810a-5d7a9d27cf51', '7356c595-071b-4a8f-8934-3e2c0bda6513', 'ae98cab9-4b57-4328-80a5-dba551c9c152', '35aed4e5-558c-4ef4-b55d-895310cdd3e9'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:32:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-27ee30ca-6829-49c3-81ac-b7e2e5e42e55 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-27ee30ca-6829-49c3-81ac-b7e2e5e42e55 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:22 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-27ee30ca-6829-49c3-81ac-b7e2e5e42e55 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:22 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-27ee30ca-6829-49c3-81ac-b7e2e5e42e55 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-27ee30ca-6829-49c3-81ac-b7e2e5e42e55 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-27ee30ca-6829-49c3-81ac-b7e2e5e42e55 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:22 devstack sudo[114604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:32:22 devstack sudo[114604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:22 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-76209bf1-a9dd-4627-a216-1de19c931ee2 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "cinder-b2a69982-36dc-4e28-90c9-7006a58640ff-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:22 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-76209bf1-a9dd-4627-a216-1de19c931ee2 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-b2a69982-36dc-4e28-90c9-7006a58640ff-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:22 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-76209bf1-a9dd-4627-a216-1de19c931ee2 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "cinder-quobyte-b2a69982-36dc-4e28-90c9-7006a58640ff" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:22 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-76209bf1-a9dd-4627-a216-1de19c931ee2 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-quobyte-b2a69982-36dc-4e28-90c9-7006a58640ff" acquired by "delete_volume" :: waited 0.025s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:22 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[df62d66f-b09b-4766-b773-08eda9e85ab8]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-76209bf1-a9dd-4627-a216-1de19c931ee2 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b2a69982-36dc-4e28-90c9-7006a58640ff {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:22 devstack sudo[114604]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-27ee30ca-6829-49c3-81ac-b7e2e5e42e55 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.907s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:22 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-27ee30ca-6829-49c3-81ac-b7e2e5e42e55 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:32:23 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-27ee30ca-6829-49c3-81ac-b7e2e5e42e55 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Deleted volume successfully. Jun 30 16:32:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-27ee30ca-6829-49c3-81ac-b7e2e5e42e55 tempest-VolumeAndVolumeTypeFromImageTest-1974950408 None] Lock "cinder-41ad37dc-ccbc-4694-8f12-ea8f049b714c-delete_volume" released by "delete_volume" :: held 4.220s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:23 devstack sudo[114610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b2a69982-36dc-4e28-90c9-7006a58640ff Jun 30 16:32:23 devstack sudo[114610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:23 devstack sudo[114602]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c9791d5b-53a4-4826-9094-43c028f1c1d7 tempest-CinderUnicodeTest-1746259110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e" returned: 0 in 1.368s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c9791d5b-53a4-4826-9094-43c028f1c1d7 tempest-CinderUnicodeTest-1746259110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.16051bed-1eb4-4b25-98b5-e2d0ac21ddb7 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:23 devstack sudo[114612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.16051bed-1eb4-4b25-98b5-e2d0ac21ddb7 1G Jun 30 16:32:23 devstack sudo[114612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:24 devstack sudo[114610]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-76209bf1-a9dd-4627-a216-1de19c931ee2 tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b2a69982-36dc-4e28-90c9-7006a58640ff" returned: 0 in 1.314s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-76209bf1-a9dd-4627-a216-1de19c931ee2 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b2a69982-36dc-4e28-90c9-7006a58640ff {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:24 devstack sudo[114621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b2a69982-36dc-4e28-90c9-7006a58640ff Jun 30 16:32:24 devstack sudo[114621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:24 devstack sudo[114612]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c9791d5b-53a4-4826-9094-43c028f1c1d7 tempest-CinderUnicodeTest-1746259110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.16051bed-1eb4-4b25-98b5-e2d0ac21ddb7 1G" returned: 0 in 1.255s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c9791d5b-53a4-4826-9094-43c028f1c1d7 tempest-CinderUnicodeTest-1746259110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.16051bed-1eb4-4b25-98b5-e2d0ac21ddb7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:24 devstack sudo[114623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.16051bed-1eb4-4b25-98b5-e2d0ac21ddb7 Jun 30 16:32:24 devstack sudo[114623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:25 devstack sudo[114621]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-76209bf1-a9dd-4627-a216-1de19c931ee2 tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b2a69982-36dc-4e28-90c9-7006a58640ff" returned: 0 in 1.048s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-76209bf1-a9dd-4627-a216-1de19c931ee2 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-quobyte-b2a69982-36dc-4e28-90c9-7006a58640ff" released by "delete_volume" :: held 2.434s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:25 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-76209bf1-a9dd-4627-a216-1de19c931ee2 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Created reservations ['d1807d8b-f9b2-44bf-a14e-5f48ebddeab5', '8ac508a3-d589-4756-b75f-2ecba4993934', 'cd6e00b9-57e6-43b6-94a8-fe48e4736ee1', 'ad3e3060-f638-4724-b611-e669bacbbf75'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:32:25 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:32:25 devstack sudo[114623]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Flow 'volume_create_manager' (f9d890e4-589e-4022-9a7f-4b26a0f4cdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be827ed8-ceff-4a50-94dc-3c7bdb6bf202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c9791d5b-53a4-4826-9094-43c028f1c1d7 tempest-CinderUnicodeTest-1746259110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.16051bed-1eb4-4b25-98b5-e2d0ac21ddb7" returned: 0 in 1.161s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:25 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-c9791d5b-53a4-4826-9094-43c028f1c1d7 tempest-CinderUnicodeTest-1746259110 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.16051bed-1eb4-4b25-98b5-e2d0ac21ddb7 is being set with open permissions: ugo+rw Jun 30 16:32:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c9791d5b-53a4-4826-9094-43c028f1c1d7 tempest-CinderUnicodeTest-1746259110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.16051bed-1eb4-4b25-98b5-e2d0ac21ddb7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:25 devstack sudo[114629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.16051bed-1eb4-4b25-98b5-e2d0ac21ddb7 Jun 30 16:32:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be827ed8-ceff-4a50-94dc-3c7bdb6bf202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d0772d-b4ce-4540-897e-8fa4479c0a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57cc283aea8c465a86e9cd2c2ad1a013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:25Z,use_quota=True,user_id='f6515bfe1e3c4d079bda5e56dca387ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:25 devstack sudo[114629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d3e4ec-6a6a-4af9-aff9-e267ec34d4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d3e4ec-6a6a-4af9-aff9-e267ec34d4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:25 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (528e6e07-cc76-4de8-a626-4674fa9d0b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:25 devstack cinder-volume[93781]: DEBUG cinder.image.glance [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Creating Keystone auth plugin from conf {{(pid=93781) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 30 16:32:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-76209bf1-a9dd-4627-a216-1de19c931ee2 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-76209bf1-a9dd-4627-a216-1de19c931ee2 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-76209bf1-a9dd-4627-a216-1de19c931ee2 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-76209bf1-a9dd-4627-a216-1de19c931ee2 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-76209bf1-a9dd-4627-a216-1de19c931ee2 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-76209bf1-a9dd-4627-a216-1de19c931ee2 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:25 devstack sudo[114631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:32:25 devstack sudo[114631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:26 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (528e6e07-cc76-4de8-a626-4674fa9d0b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '33d0772d-b4ce-4540-897e-8fa4479c0a8f', 'volume_name': 'volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f', 'volume_size': 1, 'image_id': '81d21302-c82f-4f72-b4ce-82566782e3fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81d21302-c82f-4f72-b4ce-82566782e3fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b83bea7dbe9cdf7cd8b47610a1b7e236', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '57cc283aea8c465a86e9cd2c2ad1a013', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '44027525de067866dbf01e9d7f0e4b741acf275286ba5643e95476db5fa37b441b80162edd180e7b9a778d56da4279860f47c02348acd9d9dfaecd9654d1c56c', 'id': '81d21302-c82f-4f72-b4ce-82566782e3fe', 'created_at': datetime.datetime(2026, 6, 30, 14, 32, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 14, 32, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81d21302-c82f-4f72-b4ce-82566782e3fe/file', 'properties': {}}, 'image_service': }' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:26 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23f71af-0dab-4eae-9848-7230c9c416e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:26 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23f71af-0dab-4eae-9848-7230c9c416e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:26 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f455758b-5d0c-48a9-9225-8cf76bf7b6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:26 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Volume 33d0772d-b4ce-4540-897e-8fa4479c0a8f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f', 'volume_size': 1, 'image_id': '81d21302-c82f-4f72-b4ce-82566782e3fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81d21302-c82f-4f72-b4ce-82566782e3fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b83bea7dbe9cdf7cd8b47610a1b7e236', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '57cc283aea8c465a86e9cd2c2ad1a013', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '44027525de067866dbf01e9d7f0e4b741acf275286ba5643e95476db5fa37b441b80162edd180e7b9a778d56da4279860f47c02348acd9d9dfaecd9654d1c56c', 'id': '81d21302-c82f-4f72-b4ce-82566782e3fe', 'created_at': datetime.datetime(2026, 6, 30, 14, 32, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 14, 32, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81d21302-c82f-4f72-b4ce-82566782e3fe/file', 'properties': {}}, 'image_service': } Jun 30 16:32:26 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Trying to clone 33d0772d-b4ce-4540-897e-8fa4479c0a8f from image 81d21302-c82f-4f72-b4ce-82566782e3fe at location (None, [{'url': 'file:///opt/stack/data/glance/images/81d21302-c82f-4f72-b4ce-82566782e3fe', 'metadata': {}}]). {{(pid=93781) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 30 16:32:26 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d43dd767-4689-4bdd-bcfd-b80c7e77e312 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "cinder-837971fc-cc6c-4ec4-a49b-96cc76f74c55-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:26 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d43dd767-4689-4bdd-bcfd-b80c7e77e312 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-837971fc-cc6c-4ec4-a49b-96cc76f74c55-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:26 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 30 16:32:26 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Image download 0.00 MB at 0.00 MB/s Jun 30 16:32:26 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d43dd767-4689-4bdd-bcfd-b80c7e77e312 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "cinder-quobyte-837971fc-cc6c-4ec4-a49b-96cc76f74c55" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:26 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d43dd767-4689-4bdd-bcfd-b80c7e77e312 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-quobyte-837971fc-cc6c-4ec4-a49b-96cc76f74c55" acquired by "delete_volume" :: waited 0.020s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:26 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b8e48c-134c-48f6-86bd-2310945e6714]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d43dd767-4689-4bdd-bcfd-b80c7e77e312 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-837971fc-cc6c-4ec4-a49b-96cc76f74c55 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:26 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[02afdd15-4629-40de-a89c-e42bc1298955]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:26 devstack sudo[114629]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c9791d5b-53a4-4826-9094-43c028f1c1d7 tempest-CinderUnicodeTest-1746259110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.16051bed-1eb4-4b25-98b5-e2d0ac21ddb7" returned: 0 in 0.987s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c9791d5b-53a4-4826-9094-43c028f1c1d7 tempest-CinderUnicodeTest-1746259110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:26 devstack sudo[114637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.info Jun 30 16:32:26 devstack sudo[114637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:26 devstack sudo[114631]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-76209bf1-a9dd-4627-a216-1de19c931ee2 tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.054s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:26 devstack sudo[114634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-837971fc-cc6c-4ec4-a49b-96cc76f74c55 Jun 30 16:32:26 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-76209bf1-a9dd-4627-a216-1de19c931ee2 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:32:26 devstack sudo[114634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:26 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-76209bf1-a9dd-4627-a216-1de19c931ee2 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Deleted volume successfully. Jun 30 16:32:26 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-76209bf1-a9dd-4627-a216-1de19c931ee2 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-b2a69982-36dc-4e28-90c9-7006a58640ff-delete_volume" released by "delete_volume" :: held 4.034s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:26 devstack sudo[114636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD Jun 30 16:32:26 devstack sudo[114636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:27 devstack sudo[114637]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c9791d5b-53a4-4826-9094-43c028f1c1d7 tempest-CinderUnicodeTest-1746259110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.info" returned: 0 in 0.918s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:27 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-c9791d5b-53a4-4826-9094-43c028f1c1d7 tempest-CinderUnicodeTest-1746259110 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.info is being set with open permissions: ugo+rw Jun 30 16:32:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c9791d5b-53a4-4826-9094-43c028f1c1d7 tempest-CinderUnicodeTest-1746259110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:27 devstack sudo[114648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.info Jun 30 16:32:27 devstack sudo[114648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:27 devstack sudo[114636]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD" returned: 0 in 1.089s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:27 devstack sudo[114634]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d43dd767-4689-4bdd-bcfd-b80c7e77e312 tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-837971fc-cc6c-4ec4-a49b-96cc76f74c55" returned: 0 in 1.126s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d43dd767-4689-4bdd-bcfd-b80c7e77e312 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-837971fc-cc6c-4ec4-a49b-96cc76f74c55 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:27 devstack sudo[114651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-837971fc-cc6c-4ec4-a49b-96cc76f74c55 Jun 30 16:32:27 devstack sudo[114651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:27 devstack sudo[114650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD Jun 30 16:32:27 devstack sudo[114650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:28 devstack sudo[114648]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c9791d5b-53a4-4826-9094-43c028f1c1d7 tempest-CinderUnicodeTest-1746259110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.info" returned: 0 in 0.835s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c9791d5b-53a4-4826-9094-43c028f1c1d7 tempest-CinderUnicodeTest-1746259110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.667s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:28 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-c9791d5b-53a4-4826-9094-43c028f1c1d7 tempest-CinderUnicodeTest-1746259110 None] Create snapshot completed successfully Jun 30 16:32:28 devstack sudo[114650]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD" returned: 1 in 0.928s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:32:28 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Temporary image 81d21302-c82f-4f72-b4ce-82566782e3fe is fetched for user f6515bfe1e3c4d079bda5e56dca387ec. {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 30 16:32:28 devstack sudo[114651]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d43dd767-4689-4bdd-bcfd-b80c7e77e312 tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-837971fc-cc6c-4ec4-a49b-96cc76f74c55" returned: 0 in 0.956s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:28 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d43dd767-4689-4bdd-bcfd-b80c7e77e312 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-quobyte-837971fc-cc6c-4ec4-a49b-96cc76f74c55" released by "delete_volume" :: held 2.158s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:28 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[7193ccb4-7b95-4610-8fef-0b61bacf4481]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:28 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-d43dd767-4689-4bdd-bcfd-b80c7e77e312 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Created reservations ['b9d506a5-2716-4c72-a27c-b0139fa27e06', '0a5c7cb7-282c-4bdc-b9e3-5392d54d708f', '55aa35f1-5cb6-4c23-9d78-9edadc25a338', 'caf94ed6-dd14-4ea3-8fd8-0ffc9b36424f'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:32:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d43dd767-4689-4bdd-bcfd-b80c7e77e312 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d43dd767-4689-4bdd-bcfd-b80c7e77e312 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:28 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d43dd767-4689-4bdd-bcfd-b80c7e77e312 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:28 devstack sudo[114659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD Jun 30 16:32:28 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-d43dd767-4689-4bdd-bcfd-b80c7e77e312 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:28 devstack sudo[114659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-d43dd767-4689-4bdd-bcfd-b80c7e77e312 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d43dd767-4689-4bdd-bcfd-b80c7e77e312 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:28 devstack sudo[114661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:32:28 devstack sudo[114661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e7b9ed8f-062f-456d-b5bd-ae101ea66149 tempest-CinderUnicodeTest-1746259110 None] Acquiring lock "cinder-16051bed-1eb4-4b25-98b5-e2d0ac21ddb7-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e7b9ed8f-062f-456d-b5bd-ae101ea66149 tempest-CinderUnicodeTest-1746259110 None] Lock "cinder-16051bed-1eb4-4b25-98b5-e2d0ac21ddb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e7b9ed8f-062f-456d-b5bd-ae101ea66149 tempest-CinderUnicodeTest-1746259110 None] Acquiring lock "cinder-quobyte-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Flow 'volume_create_manager' (912ef9df-d338-4af8-aea2-90a00e2f55bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9834297-be16-45c6-b0d8-7069955c22a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e7b9ed8f-062f-456d-b5bd-ae101ea66149 tempest-CinderUnicodeTest-1746259110 None] Lock "cinder-quobyte-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e" acquired by "delete_snapshot" :: waited 0.059s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e7b9ed8f-062f-456d-b5bd-ae101ea66149 tempest-CinderUnicodeTest-1746259110 None] Acquiring lock "cinder-quobyte-16051bed-1eb4-4b25-98b5-e2d0ac21ddb7" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9834297-be16-45c6-b0d8-7069955c22a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-480795741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94a62c7-e3fc-4a58-b81b-e02291216bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af72a5c81d1843509df5547f1d9e52ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:29Z,use_quota=True,user_id='bc031ec6aa954a55aadf1e01f46d0022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccc23db-23df-4536-b8b1-e77ad41692ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccc23db-23df-4536-b8b1-e77ad41692ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73cf322-67ed-4866-9b81-0f2bf3e8e5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73cf322-67ed-4866-9b81-0f2bf3e8e5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c94a62c7-e3fc-4a58-b81b-e02291216bbc', 'volume_name': 'volume-c94a62c7-e3fc-4a58-b81b-e02291216bbc', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e199a8ab-af20-4a59-9bcd-07f9c540a603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e199a8ab-af20-4a59-9bcd-07f9c540a603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0d2db6-0055-4e3e-a062-7251e06669b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:29 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Volume c94a62c7-e3fc-4a58-b81b-e02291216bbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c94a62c7-e3fc-4a58-b81b-e02291216bbc', 'volume_size': 1} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-480795741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94a62c7-e3fc-4a58-b81b-e02291216bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af72a5c81d1843509df5547f1d9e52ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:29Z,use_quota=True,user_id='bc031ec6aa954a55aadf1e01f46d0022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Creating volume c94a62c7-e3fc-4a58-b81b-e02291216bbc {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:32:29 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c94a62c7-e3fc-4a58-b81b-e02291216bbc 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e7b9ed8f-062f-456d-b5bd-ae101ea66149 tempest-CinderUnicodeTest-1746259110 None] Lock "cinder-quobyte-16051bed-1eb4-4b25-98b5-e2d0ac21ddb7" acquired by "_delete_snapshot" :: waited 0.097s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-e7b9ed8f-062f-456d-b5bd-ae101ea66149 tempest-CinderUnicodeTest-1746259110 None] Deleting offline snapshot 16051bed-1eb4-4b25-98b5-e2d0ac21ddb7 of volume b4e348dd-5c48-4a1c-a98b-e4e83c6c773e {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:32:29 devstack sudo[114663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c94a62c7-e3fc-4a58-b81b-e02291216bbc 1073741824 Jun 30 16:32:29 devstack sudo[114663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-e7b9ed8f-062f-456d-b5bd-ae101ea66149 tempest-CinderUnicodeTest-1746259110 None] snapshot_file for this snap is: volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.16051bed-1eb4-4b25-98b5-e2d0ac21ddb7 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3e933e-88cb-4403-9d77-d2e727a4e363]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e7b9ed8f-062f-456d-b5bd-ae101ea66149 tempest-CinderUnicodeTest-1746259110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.16051bed-1eb4-4b25-98b5-e2d0ac21ddb7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:29 devstack sudo[114665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.16051bed-1eb4-4b25-98b5-e2d0ac21ddb7 Jun 30 16:32:29 devstack sudo[114665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:29 devstack sudo[114659]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD" returned: 0 in 0.947s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-55234c89-1229-46a7-b22f-a759bd1d23db tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "cinder-f95a3f9c-c61d-4085-a6da-07e4a6bb752f-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-55234c89-1229-46a7-b22f-a759bd1d23db tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-f95a3f9c-c61d-4085-a6da-07e4a6bb752f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:29 devstack sudo[114669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD Jun 30 16:32:29 devstack sudo[114669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:29 devstack sudo[114661]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d43dd767-4689-4bdd-bcfd-b80c7e77e312 tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.048s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-d43dd767-4689-4bdd-bcfd-b80c7e77e312 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-55234c89-1229-46a7-b22f-a759bd1d23db tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "cinder-quobyte-f95a3f9c-c61d-4085-a6da-07e4a6bb752f" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:29 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-d43dd767-4689-4bdd-bcfd-b80c7e77e312 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Deleted volume successfully. Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-55234c89-1229-46a7-b22f-a759bd1d23db tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-quobyte-f95a3f9c-c61d-4085-a6da-07e4a6bb752f" acquired by "delete_volume" :: waited 0.041s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d43dd767-4689-4bdd-bcfd-b80c7e77e312 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-837971fc-cc6c-4ec4-a49b-96cc76f74c55-delete_volume" released by "delete_volume" :: held 3.597s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[1512119a-9f2b-4d20-8e39-10f52dfa4d61]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-55234c89-1229-46a7-b22f-a759bd1d23db tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f95a3f9c-c61d-4085-a6da-07e4a6bb752f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:30 devstack sudo[114672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f95a3f9c-c61d-4085-a6da-07e4a6bb752f Jun 30 16:32:30 devstack sudo[114672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:30 devstack sudo[114665]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e7b9ed8f-062f-456d-b5bd-ae101ea66149 tempest-CinderUnicodeTest-1746259110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.16051bed-1eb4-4b25-98b5-e2d0ac21ddb7" returned: 0 in 1.057s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-e7b9ed8f-062f-456d-b5bd-ae101ea66149 tempest-CinderUnicodeTest-1746259110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:32:30 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc467db-c9b4-4ac6-b923-7357ab9983d2]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e7b9ed8f-062f-456d-b5bd-ae101ea66149 tempest-CinderUnicodeTest-1746259110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:30 devstack sudo[114663]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c94a62c7-e3fc-4a58-b81b-e02291216bbc 1073741824" returned: 0 in 1.208s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c94a62c7-e3fc-4a58-b81b-e02291216bbc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:30 devstack sudo[114669]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:30 devstack sudo[114685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c94a62c7-e3fc-4a58-b81b-e02291216bbc Jun 30 16:32:30 devstack sudo[114685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD" returned: 1 in 0.971s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:32:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:30 devstack sudo[114684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e Jun 30 16:32:30 devstack sudo[114684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:30 devstack sudo[114672]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-55234c89-1229-46a7-b22f-a759bd1d23db tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f95a3f9c-c61d-4085-a6da-07e4a6bb752f" returned: 0 in 0.907s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-55234c89-1229-46a7-b22f-a759bd1d23db tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f95a3f9c-c61d-4085-a6da-07e4a6bb752f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:30 devstack sudo[114691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f95a3f9c-c61d-4085-a6da-07e4a6bb752f Jun 30 16:32:30 devstack sudo[114691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:31 devstack sudo[114685]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c94a62c7-e3fc-4a58-b81b-e02291216bbc" returned: 0 in 0.770s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] <== create_volume: return (2028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.739s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d0772d-b4ce-4540-897e-8fa4479c0a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57cc283aea8c465a86e9cd2c2ad1a013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:25Z,use_quota=True,user_id='f6515bfe1e3c4d079bda5e56dca387ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Creating volume 33d0772d-b4ce-4540-897e-8fa4479c0a8f {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:32:31 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:31 devstack sudo[114697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f 1073741824 Jun 30 16:32:31 devstack sudo[114697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0d2db6-0055-4e3e-a062-7251e06669b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c94a62c7-e3fc-4a58-b81b-e02291216bbc', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:31 devstack sudo[114684]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0b031c-e8da-41fc-9090-614ae276203c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e7b9ed8f-062f-456d-b5bd-ae101ea66149 tempest-CinderUnicodeTest-1746259110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e" returned: 0 in 0.929s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e7b9ed8f-062f-456d-b5bd-ae101ea66149 tempest-CinderUnicodeTest-1746259110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.16051bed-1eb4-4b25-98b5-e2d0ac21ddb7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:31 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Volume volume-c94a62c7-e3fc-4a58-b81b-e02291216bbc (c94a62c7-e3fc-4a58-b81b-e02291216bbc): created successfully Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0b031c-e8da-41fc-9090-614ae276203c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:31 devstack sudo[114699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.16051bed-1eb4-4b25-98b5-e2d0ac21ddb7 Jun 30 16:32:31 devstack sudo[114699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Flow 'volume_create_manager' (912ef9df-d338-4af8-aea2-90a00e2f55bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:31 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-a5592c6d-d5c0-4b94-aeba-b101ce66a300 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Created volume successfully. Jun 30 16:32:31 devstack sudo[114691]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-55234c89-1229-46a7-b22f-a759bd1d23db tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f95a3f9c-c61d-4085-a6da-07e4a6bb752f" returned: 0 in 0.776s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-55234c89-1229-46a7-b22f-a759bd1d23db tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-quobyte-f95a3f9c-c61d-4085-a6da-07e4a6bb752f" released by "delete_volume" :: held 1.730s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-55234c89-1229-46a7-b22f-a759bd1d23db tempest-CreateVolumesFromSnapshotTest-2056289189 None] Created reservations ['b0bdbf1c-c814-4919-8db5-c22f8c8aab27', '5a6cd850-3f61-4964-83bc-518cb64d792b', '9c685a01-63ba-42d7-9be4-09dfa21e7a65', '69dc8ab8-ea8e-4af8-a907-285bc207f087'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-55234c89-1229-46a7-b22f-a759bd1d23db tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-55234c89-1229-46a7-b22f-a759bd1d23db tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-55234c89-1229-46a7-b22f-a759bd1d23db tempest-CreateVolumesFromSnapshotTest-2056289189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-55234c89-1229-46a7-b22f-a759bd1d23db tempest-CreateVolumesFromSnapshotTest-2056289189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-55234c89-1229-46a7-b22f-a759bd1d23db tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-55234c89-1229-46a7-b22f-a759bd1d23db tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:31 devstack sudo[114702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:32:31 devstack sudo[114702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:31 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-23d74018-e885-4d6b-b580-4a28b0aa4473 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "cinder-ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:32 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-23d74018-e885-4d6b-b580-4a28b0aa4473 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:32 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-23d74018-e885-4d6b-b580-4a28b0aa4473 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "cinder-quobyte-ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:32 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-23d74018-e885-4d6b-b580-4a28b0aa4473 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-quobyte-ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe" acquired by "delete_volume" :: waited 0.017s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:32 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f97f4b2-52ae-4560-9006-fe795cbb0fc1]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-23d74018-e885-4d6b-b580-4a28b0aa4473 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:32 devstack sudo[114709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe Jun 30 16:32:32 devstack sudo[114709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:32 devstack sudo[114699]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e7b9ed8f-062f-456d-b5bd-ae101ea66149 tempest-CinderUnicodeTest-1746259110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.16051bed-1eb4-4b25-98b5-e2d0ac21ddb7" returned: 0 in 1.091s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e7b9ed8f-062f-456d-b5bd-ae101ea66149 tempest-CinderUnicodeTest-1746259110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.16051bed-1eb4-4b25-98b5-e2d0ac21ddb7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:32 devstack sudo[114712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.16051bed-1eb4-4b25-98b5-e2d0ac21ddb7 Jun 30 16:32:32 devstack sudo[114712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:32 devstack sudo[114697]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f 1073741824" returned: 0 in 1.318s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:32 devstack sudo[114702]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-55234c89-1229-46a7-b22f-a759bd1d23db tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.957s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:32 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-55234c89-1229-46a7-b22f-a759bd1d23db tempest-CreateVolumesFromSnapshotTest-2056289189 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:32:32 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-55234c89-1229-46a7-b22f-a759bd1d23db tempest-CreateVolumesFromSnapshotTest-2056289189 None] Deleted volume successfully. Jun 30 16:32:32 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:32 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-55234c89-1229-46a7-b22f-a759bd1d23db tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-f95a3f9c-c61d-4085-a6da-07e4a6bb752f-delete_volume" released by "delete_volume" :: held 3.019s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:32 devstack sudo[114715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f Jun 30 16:32:32 devstack sudo[114715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:33 devstack sudo[114720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:32:33 devstack sudo[114720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Flow 'volume_create_manager' (25da8fdb-a246-438d-82f4-9ef6b9659443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce960e3e-3512-4921-ab13-471c2a62bce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:33 devstack sudo[114709]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce960e3e-3512-4921-ab13-471c2a62bce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1383037252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69ec689-ab6c-46a4-872e-4de774338258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af72a5c81d1843509df5547f1d9e52ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:33Z,use_quota=True,user_id='bc031ec6aa954a55aadf1e01f46d0022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5f8510-bb65-442f-86fa-4937e0dcef92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5f8510-bb65-442f-86fa-4937e0dcef92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c3fef98-1ddc-441d-b10d-4dce07ef7e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c3fef98-1ddc-441d-b10d-4dce07ef7e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b69ec689-ab6c-46a4-872e-4de774338258', 'volume_name': 'volume-b69ec689-ab6c-46a4-872e-4de774338258', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8862cf-cf95-4016-a627-59eec1a8badc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8862cf-cf95-4016-a627-59eec1a8badc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c7ead7-0c69-4971-99a8-6a5e3a3c952f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:33 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Volume b69ec689-ab6c-46a4-872e-4de774338258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b69ec689-ab6c-46a4-872e-4de774338258', 'volume_size': 1} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-23d74018-e885-4d6b-b580-4a28b0aa4473 tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe" returned: 0 in 1.301s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-23d74018-e885-4d6b-b580-4a28b0aa4473 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:33 devstack sudo[114723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe Jun 30 16:32:33 devstack sudo[114723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:33 devstack sudo[114712]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-e7b9ed8f-062f-456d-b5bd-ae101ea66149 tempest-CinderUnicodeTest-1746259110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e.16051bed-1eb4-4b25-98b5-e2d0ac21ddb7" returned: 0 in 1.127s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e7b9ed8f-062f-456d-b5bd-ae101ea66149 tempest-CinderUnicodeTest-1746259110 None] Lock "cinder-quobyte-16051bed-1eb4-4b25-98b5-e2d0ac21ddb7" released by "_delete_snapshot" :: held 4.377s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e7b9ed8f-062f-456d-b5bd-ae101ea66149 tempest-CinderUnicodeTest-1746259110 None] Lock "cinder-quobyte-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e" released by "delete_snapshot" :: held 4.485s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-e7b9ed8f-062f-456d-b5bd-ae101ea66149 tempest-CinderUnicodeTest-1746259110 None] Created reservations ['d5fe03ad-2564-496d-ba67-501ccbf3e4cd', 'ac086c49-48f5-442f-bbe0-e3eb2b2e221e', 'ee278bae-258d-4604-a980-5f455c824217', '4d1c361c-38de-4497-9470-04785ed4171d'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Flow 'volume_create_manager' (542a7009-57b7-40a5-968c-9f7a7c5c7991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a099f578-3ab5-424d-bf0f-4e7a87725853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a099f578-3ab5-424d-bf0f-4e7a87725853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-844043538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3cdd3c4-f62a-4a83-83fd-b1a2b842727b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af72a5c81d1843509df5547f1d9e52ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:34Z,use_quota=True,user_id='bc031ec6aa954a55aadf1e01f46d0022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:33 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac2e6ad-b975-4250-97a5-e99f2063155e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac2e6ad-b975-4250-97a5-e99f2063155e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8e38fa-290f-4e21-8dd7-07576eb95f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8e38fa-290f-4e21-8dd7-07576eb95f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3cdd3c4-f62a-4a83-83fd-b1a2b842727b', 'volume_name': 'volume-f3cdd3c4-f62a-4a83-83fd-b1a2b842727b', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ca9a75-6072-4507-b438-fb7fac75cfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ca9a75-6072-4507-b438-fb7fac75cfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:34 devstack sudo[114715]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5652f7-5487-42a7-ac96-d58dca043551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:34 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Volume f3cdd3c4-f62a-4a83-83fd-b1a2b842727b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3cdd3c4-f62a-4a83-83fd-b1a2b842727b', 'volume_size': 1} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f" returned: 0 in 1.324s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] <== create_volume: return (2774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.778s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.655s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1383037252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69ec689-ab6c-46a4-872e-4de774338258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af72a5c81d1843509df5547f1d9e52ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:33Z,use_quota=True,user_id='bc031ec6aa954a55aadf1e01f46d0022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Creating volume b69ec689-ab6c-46a4-872e-4de774338258 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:32:34 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b69ec689-ab6c-46a4-872e-4de774338258 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:34 devstack sudo[114727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b69ec689-ab6c-46a4-872e-4de774338258 1073741824 Jun 30 16:32:34 devstack sudo[114727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:34 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-e7b9ed8f-062f-456d-b5bd-ae101ea66149 tempest-CinderUnicodeTest-1746259110 None] Delete snapshot completed successfully. Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Attempting download of 81d21302-c82f-4f72-b4ce-82566782e3fe ((None, [{'url': 'file:///opt/stack/data/glance/images/81d21302-c82f-4f72-b4ce-82566782e3fe', 'metadata': {}}])) to volume 33d0772d-b4ce-4540-897e-8fa4479c0a8f. {{(pid=93781) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 30 16:32:34 devstack sudo[114720]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.058s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-e7b9ed8f-062f-456d-b5bd-ae101ea66149 tempest-CinderUnicodeTest-1746259110 None] Lock "cinder-16051bed-1eb4-4b25-98b5-e2d0ac21ddb7-delete_snapshot" released by "delete_snapshot" :: held 5.072s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 28 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[5310f06e-cedf-4409-9ff5-7d34ce715ecc]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81d21302-c82f-4f72-b4ce-82566782e3fe_hqbcqbil {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:32:34 devstack sudo[114729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81d21302-c82f-4f72-b4ce-82566782e3fe_hqbcqbil Jun 30 16:32:34 devstack sudo[114729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Flow 'volume_create_manager' (abb3d7e7-140d-430c-a979-45bb2e3c14b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3391ec41-fd1e-4445-953a-fda01603ebb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c7f8ebbe-f46c-4ada-8ef2-f6ea65bd3b15 tempest-CinderUnicodeTest-1746259110 None] Acquiring lock "cinder-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3391ec41-fd1e-4445-953a-fda01603ebb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1125369729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b00af8-b92e-410e-af75-df96827a2ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af72a5c81d1843509df5547f1d9e52ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:34Z,use_quota=True,user_id='bc031ec6aa954a55aadf1e01f46d0022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67eea5db-1895-4ef0-8200-f081a7222810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67eea5db-1895-4ef0-8200-f081a7222810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d1686fe-aac4-481a-ad56-ff748bf8b957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d1686fe-aac4-481a-ad56-ff748bf8b957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84b00af8-b92e-410e-af75-df96827a2ab8', 'volume_name': 'volume-84b00af8-b92e-410e-af75-df96827a2ab8', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ee6dba-663c-4d3f-9de2-4667ab0a8a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:34 devstack sudo[114723]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ee6dba-663c-4d3f-9de2-4667ab0a8a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc2f24b-af01-406c-af26-ff4b26ff82d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:34 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Volume 84b00af8-b92e-410e-af75-df96827a2ab8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84b00af8-b92e-410e-af75-df96827a2ab8', 'volume_size': 1} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-23d74018-e885-4d6b-b580-4a28b0aa4473 tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe" returned: 0 in 1.259s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c7f8ebbe-f46c-4ada-8ef2-f6ea65bd3b15 tempest-CinderUnicodeTest-1746259110 None] Lock "cinder-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-23d74018-e885-4d6b-b580-4a28b0aa4473 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-quobyte-ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe" released by "delete_volume" :: held 2.617s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c7f8ebbe-f46c-4ada-8ef2-f6ea65bd3b15 tempest-CinderUnicodeTest-1746259110 None] Acquiring lock "cinder-quobyte-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c7f8ebbe-f46c-4ada-8ef2-f6ea65bd3b15 tempest-CinderUnicodeTest-1746259110 None] Lock "cinder-quobyte-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e" acquired by "delete_volume" :: waited 0.026s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[012694c5-07d7-4115-ad53-9496560627bb]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c7f8ebbe-f46c-4ada-8ef2-f6ea65bd3b15 tempest-CinderUnicodeTest-1746259110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-23d74018-e885-4d6b-b580-4a28b0aa4473 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Created reservations ['f680eed1-1aab-42f2-8c98-a133aaf9efdc', '6dd3b29e-9be0-46ba-bd6f-36db15dacce6', 'a6b50b87-6f31-4bfa-b548-e291b89d85b4', '4b049013-2224-4bee-bdba-40655c23f518'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-23d74018-e885-4d6b-b580-4a28b0aa4473 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-23d74018-e885-4d6b-b580-4a28b0aa4473 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-23d74018-e885-4d6b-b580-4a28b0aa4473 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-23d74018-e885-4d6b-b580-4a28b0aa4473 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-23d74018-e885-4d6b-b580-4a28b0aa4473 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-23d74018-e885-4d6b-b580-4a28b0aa4473 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:35 devstack sudo[114732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e Jun 30 16:32:35 devstack sudo[114732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:35 devstack sudo[114736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:32:35 devstack sudo[114736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:35 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:32:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Flow 'volume_create_manager' (d82b287e-1a19-4e30-80c5-daa475e4b8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807bf987-ba8b-4d0f-ba36-ca24f50a5d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807bf987-ba8b-4d0f-ba36-ca24f50a5d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-503738944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9558e1db-d44d-4076-850f-2dcf21d1039f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af72a5c81d1843509df5547f1d9e52ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:35Z,use_quota=True,user_id='bc031ec6aa954a55aadf1e01f46d0022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9bfc95-0dec-4452-8109-3743e3909e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9bfc95-0dec-4452-8109-3743e3909e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:35 devstack sudo[114727]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54f7a40-b2f9-4fc8-b772-eaa6fe65d685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54f7a40-b2f9-4fc8-b772-eaa6fe65d685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9558e1db-d44d-4076-850f-2dcf21d1039f', 'volume_name': 'volume-9558e1db-d44d-4076-850f-2dcf21d1039f', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfdf9ed9-378e-49ec-88d6-5d63c352d6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfdf9ed9-378e-49ec-88d6-5d63c352d6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:35 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d23a1bc9-5fad-44c9-961d-4c64c8b13ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:35 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Volume 9558e1db-d44d-4076-850f-2dcf21d1039f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9558e1db-d44d-4076-850f-2dcf21d1039f', 'volume_size': 1} Jun 30 16:32:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b69ec689-ab6c-46a4-872e-4de774338258 1073741824" returned: 0 in 1.394s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b69ec689-ab6c-46a4-872e-4de774338258 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:35 devstack sudo[114740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b69ec689-ab6c-46a4-872e-4de774338258 Jun 30 16:32:35 devstack sudo[114740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:35 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a802b338-d4ef-4326-886b-25e6c0cb7f1e tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "cinder-87a283db-04d8-46c2-bc23-7b1fd16f2b11-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:35 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a802b338-d4ef-4326-886b-25e6c0cb7f1e tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-87a283db-04d8-46c2-bc23-7b1fd16f2b11-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:35 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a802b338-d4ef-4326-886b-25e6c0cb7f1e tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "cinder-quobyte-87a283db-04d8-46c2-bc23-7b1fd16f2b11" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:35 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a802b338-d4ef-4326-886b-25e6c0cb7f1e tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-quobyte-87a283db-04d8-46c2-bc23-7b1fd16f2b11" acquired by "delete_volume" :: waited 0.017s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:35 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab59ff91-4f4e-4698-8717-cfbfb159bdc2]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a802b338-d4ef-4326-886b-25e6c0cb7f1e tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-87a283db-04d8-46c2-bc23-7b1fd16f2b11 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:35 devstack sudo[114729]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_81d21302-c82f-4f72-b4ce-82566782e3fe_hqbcqbil" returned: 0 in 1.673s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:35 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81d21302-c82f-4f72-b4ce-82566782e3fe_hqbcqbil {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:35 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:32:36 devstack sudo[114744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-87a283db-04d8-46c2-bc23-7b1fd16f2b11 Jun 30 16:32:36 devstack sudo[114744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Flow 'volume_create_manager' (341f785c-3ad0-47b4-98bd-ade67902b0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21dc345d-1fed-467b-961f-babbcc94c03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21dc345d-1fed-467b-961f-babbcc94c03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1455659644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac5a765-f87a-4ce3-99b7-f49fc7add867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af72a5c81d1843509df5547f1d9e52ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:36Z,use_quota=True,user_id='bc031ec6aa954a55aadf1e01f46d0022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ffef37-120e-4005-82af-dbb5bf4ffa81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ffef37-120e-4005-82af-dbb5bf4ffa81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b71db2-b41c-498b-b40e-f37de8247e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b71db2-b41c-498b-b40e-f37de8247e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ac5a765-f87a-4ce3-99b7-f49fc7add867', 'volume_name': 'volume-0ac5a765-f87a-4ce3-99b7-f49fc7add867', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca527ab7-376b-4ac5-8bcb-1bcb6747ac89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca527ab7-376b-4ac5-8bcb-1bcb6747ac89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa3cb96-8115-4d43-920d-322fd7c279d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:36 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Volume 0ac5a765-f87a-4ce3-99b7-f49fc7add867: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ac5a765-f87a-4ce3-99b7-f49fc7add867', 'volume_size': 1} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:36 devstack sudo[114745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81d21302-c82f-4f72-b4ce-82566782e3fe_hqbcqbil Jun 30 16:32:36 devstack sudo[114745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:36 devstack sudo[114736]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-23d74018-e885-4d6b-b580-4a28b0aa4473 tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.418s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-23d74018-e885-4d6b-b580-4a28b0aa4473 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:32:36 devstack sudo[114732]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:36 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-23d74018-e885-4d6b-b580-4a28b0aa4473 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Deleted volume successfully. Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c7f8ebbe-f46c-4ada-8ef2-f6ea65bd3b15 tempest-CinderUnicodeTest-1746259110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e" returned: 0 in 1.610s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c7f8ebbe-f46c-4ada-8ef2-f6ea65bd3b15 tempest-CinderUnicodeTest-1746259110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-23d74018-e885-4d6b-b580-4a28b0aa4473 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-ef9031fa-ebd8-4b64-8c7e-b6cf4e33d8fe-delete_volume" released by "delete_volume" :: held 4.483s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:36 devstack sudo[114753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e Jun 30 16:32:36 devstack sudo[114753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:36 devstack sudo[114740]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b69ec689-ab6c-46a4-872e-4de774338258" returned: 0 in 1.187s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] <== create_volume: return (2642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.646s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.670s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-844043538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3cdd3c4-f62a-4a83-83fd-b1a2b842727b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af72a5c81d1843509df5547f1d9e52ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:34Z,use_quota=True,user_id='bc031ec6aa954a55aadf1e01f46d0022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Creating volume f3cdd3c4-f62a-4a83-83fd-b1a2b842727b {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:32:36 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f3cdd3c4-f62a-4a83-83fd-b1a2b842727b 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c7ead7-0c69-4971-99a8-6a5e3a3c952f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b69ec689-ab6c-46a4-872e-4de774338258', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:36 devstack sudo[114756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f3cdd3c4-f62a-4a83-83fd-b1a2b842727b 1073741824 Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feae54a5-50b7-4d69-a076-198c0bbfa978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:36 devstack sudo[114756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:36 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Volume volume-b69ec689-ab6c-46a4-872e-4de774338258 (b69ec689-ab6c-46a4-872e-4de774338258): created successfully Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feae54a5-50b7-4d69-a076-198c0bbfa978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:36 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Flow 'volume_create_manager' (25da8fdb-a246-438d-82f4-9ef6b9659443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:36 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-c640d928-9526-4c75-bb53-fbb7b032538d tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Created volume successfully. Jun 30 16:32:37 devstack sudo[114744]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a802b338-d4ef-4326-886b-25e6c0cb7f1e tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-87a283db-04d8-46c2-bc23-7b1fd16f2b11" returned: 0 in 1.382s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a802b338-d4ef-4326-886b-25e6c0cb7f1e tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-87a283db-04d8-46c2-bc23-7b1fd16f2b11 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:37 devstack sudo[114745]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81d21302-c82f-4f72-b4ce-82566782e3fe_hqbcqbil" returned: 1 in 1.219s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_81d21302-c82f-4f72-b4ce-82566782e3fe_hqbcqbil' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:32:37 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[d487e4bf-6072-4e35-b481-1fbd3851cd21]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:37 devstack sudo[114763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-87a283db-04d8-46c2-bc23-7b1fd16f2b11 Jun 30 16:32:37 devstack sudo[114763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:37 devstack sudo[114764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD Jun 30 16:32:37 devstack sudo[114764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:37 devstack sudo[114753]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c7f8ebbe-f46c-4ada-8ef2-f6ea65bd3b15 tempest-CinderUnicodeTest-1746259110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e" returned: 0 in 1.090s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:37 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c7f8ebbe-f46c-4ada-8ef2-f6ea65bd3b15 tempest-CinderUnicodeTest-1746259110 None] Lock "cinder-quobyte-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e" released by "delete_volume" :: held 2.811s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:37 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-c7f8ebbe-f46c-4ada-8ef2-f6ea65bd3b15 tempest-CinderUnicodeTest-1746259110 None] Created reservations ['49baae3f-b9cb-4b36-8561-740a3986a069', 'f2480340-72a7-4b4d-a722-2b8ef43e6e23', '0a0f8570-55bf-4368-b1ef-92aaa96681c4', 'ec0e7bb8-fd4f-4871-9eb2-c0ff9bd33274'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:32:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c7f8ebbe-f46c-4ada-8ef2-f6ea65bd3b15 tempest-CinderUnicodeTest-1746259110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c7f8ebbe-f46c-4ada-8ef2-f6ea65bd3b15 tempest-CinderUnicodeTest-1746259110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c7f8ebbe-f46c-4ada-8ef2-f6ea65bd3b15 tempest-CinderUnicodeTest-1746259110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:37 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c7f8ebbe-f46c-4ada-8ef2-f6ea65bd3b15 tempest-CinderUnicodeTest-1746259110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c7f8ebbe-f46c-4ada-8ef2-f6ea65bd3b15 tempest-CinderUnicodeTest-1746259110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c7f8ebbe-f46c-4ada-8ef2-f6ea65bd3b15 tempest-CinderUnicodeTest-1746259110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:37 devstack sudo[114773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:32:37 devstack sudo[114773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:38 devstack sudo[114756]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f3cdd3c4-f62a-4a83-83fd-b1a2b842727b 1073741824" returned: 0 in 1.358s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:38 devstack sudo[114763]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a802b338-d4ef-4326-886b-25e6c0cb7f1e tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-87a283db-04d8-46c2-bc23-7b1fd16f2b11" returned: 0 in 0.953s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a802b338-d4ef-4326-886b-25e6c0cb7f1e tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-quobyte-87a283db-04d8-46c2-bc23-7b1fd16f2b11" released by "delete_volume" :: held 2.417s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f3cdd3c4-f62a-4a83-83fd-b1a2b842727b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:38 devstack sudo[114778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f3cdd3c4-f62a-4a83-83fd-b1a2b842727b Jun 30 16:32:38 devstack sudo[114778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:38 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-a802b338-d4ef-4326-886b-25e6c0cb7f1e tempest-CreateVolumesFromSnapshotTest-2056289189 None] Created reservations ['716bd803-155b-4530-b9ed-a8848fcccc3b', 'efb5650e-af94-4437-b600-7bfbe7692aa7', '14e6ddb8-1a67-428a-b009-6e0ec13f1b30', '825ca814-5abf-43d6-8199-b3c96e6ffbbf'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:32:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-82fe6860-6ee3-4688-9a21-0d1a0d24106b tempest-CinderUnicodeTest-1746259110 None] Acquiring lock "cinder-d207a5fe-d2e6-441f-acc5-2b06dad1146c-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-82fe6860-6ee3-4688-9a21-0d1a0d24106b tempest-CinderUnicodeTest-1746259110 None] Lock "cinder-d207a5fe-d2e6-441f-acc5-2b06dad1146c-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-82fe6860-6ee3-4688-9a21-0d1a0d24106b tempest-CinderUnicodeTest-1746259110 None] Acquiring lock "cinder-quobyte-d207a5fe-d2e6-441f-acc5-2b06dad1146c" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-82fe6860-6ee3-4688-9a21-0d1a0d24106b tempest-CinderUnicodeTest-1746259110 None] Lock "cinder-quobyte-d207a5fe-d2e6-441f-acc5-2b06dad1146c" acquired by "delete_volume" :: waited 0.032s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a802b338-d4ef-4326-886b-25e6c0cb7f1e tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a802b338-d4ef-4326-886b-25e6c0cb7f1e tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a802b338-d4ef-4326-886b-25e6c0cb7f1e tempest-CreateVolumesFromSnapshotTest-2056289189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:38 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a802b338-d4ef-4326-886b-25e6c0cb7f1e tempest-CreateVolumesFromSnapshotTest-2056289189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a802b338-d4ef-4326-886b-25e6c0cb7f1e tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a802b338-d4ef-4326-886b-25e6c0cb7f1e tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:38 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc22447-2a01-4ad6-b8a6-ff54ba5b3edc]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-82fe6860-6ee3-4688-9a21-0d1a0d24106b tempest-CinderUnicodeTest-1746259110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d207a5fe-d2e6-441f-acc5-2b06dad1146c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:38 devstack sudo[114764]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD" returned: 0 in 1.348s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:38 devstack sudo[114780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:32:38 devstack sudo[114780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:38 devstack sudo[114783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD Jun 30 16:32:38 devstack sudo[114783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:38 devstack sudo[114781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d207a5fe-d2e6-441f-acc5-2b06dad1146c Jun 30 16:32:38 devstack sudo[114781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:39 devstack sudo[114773]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c7f8ebbe-f46c-4ada-8ef2-f6ea65bd3b15 tempest-CinderUnicodeTest-1746259110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.261s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-c7f8ebbe-f46c-4ada-8ef2-f6ea65bd3b15 tempest-CinderUnicodeTest-1746259110 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:32:39 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-c7f8ebbe-f46c-4ada-8ef2-f6ea65bd3b15 tempest-CinderUnicodeTest-1746259110 None] Deleted volume successfully. Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-c7f8ebbe-f46c-4ada-8ef2-f6ea65bd3b15 tempest-CinderUnicodeTest-1746259110 None] Lock "cinder-b4e348dd-5c48-4a1c-a98b-e4e83c6c773e-delete_volume" released by "delete_volume" :: held 4.427s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d375c9c4-a07d-47ae-a72d-33e123ae2290 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "cinder-af74ce47-57df-4765-a3e9-f59d5b53d15f-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d375c9c4-a07d-47ae-a72d-33e123ae2290 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-af74ce47-57df-4765-a3e9-f59d5b53d15f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d375c9c4-a07d-47ae-a72d-33e123ae2290 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "cinder-quobyte-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:39 devstack sudo[114778]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d375c9c4-a07d-47ae-a72d-33e123ae2290 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-quobyte-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d375c9c4-a07d-47ae-a72d-33e123ae2290 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "cinder-quobyte-af74ce47-57df-4765-a3e9-f59d5b53d15f" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f3cdd3c4-f62a-4a83-83fd-b1a2b842727b" returned: 0 in 1.126s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] <== create_volume: return (2593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.599s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.652s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1125369729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b00af8-b92e-410e-af75-df96827a2ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af72a5c81d1843509df5547f1d9e52ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:34Z,use_quota=True,user_id='bc031ec6aa954a55aadf1e01f46d0022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Creating volume 84b00af8-b92e-410e-af75-df96827a2ab8 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:32:39 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-84b00af8-b92e-410e-af75-df96827a2ab8 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d375c9c4-a07d-47ae-a72d-33e123ae2290 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-quobyte-af74ce47-57df-4765-a3e9-f59d5b53d15f" acquired by "_delete_snapshot" :: waited 0.097s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-d375c9c4-a07d-47ae-a72d-33e123ae2290 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Deleting offline snapshot af74ce47-57df-4765-a3e9-f59d5b53d15f of volume 3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:32:39 devstack sudo[114780]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:39 devstack sudo[114789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-84b00af8-b92e-410e-af75-df96827a2ab8 1073741824 Jun 30 16:32:39 devstack sudo[114789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-d375c9c4-a07d-47ae-a72d-33e123ae2290 tempest-CreateVolumesFromSnapshotTest-2056289189 None] snapshot_file for this snap is: volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.af74ce47-57df-4765-a3e9-f59d5b53d15f {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a802b338-d4ef-4326-886b-25e6c0cb7f1e tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.964s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a802b338-d4ef-4326-886b-25e6c0cb7f1e tempest-CreateVolumesFromSnapshotTest-2056289189 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5652f7-5487-42a7-ac96-d58dca043551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3cdd3c4-f62a-4a83-83fd-b1a2b842727b', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ea548b-9977-442e-8e30-ebf85a3be144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9ae343-136e-41ae-a1d1-078da84a5e56]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d375c9c4-a07d-47ae-a72d-33e123ae2290 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.af74ce47-57df-4765-a3e9-f59d5b53d15f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:39 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-a802b338-d4ef-4326-886b-25e6c0cb7f1e tempest-CreateVolumesFromSnapshotTest-2056289189 None] Deleted volume successfully. Jun 30 16:32:39 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Volume volume-f3cdd3c4-f62a-4a83-83fd-b1a2b842727b (f3cdd3c4-f62a-4a83-83fd-b1a2b842727b): created successfully Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ea548b-9977-442e-8e30-ebf85a3be144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Flow 'volume_create_manager' (542a7009-57b7-40a5-968c-9f7a7c5c7991) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:39 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-c86d9db9-884e-4c6d-b2ed-cdd3fea23f17 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Created volume successfully. Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-a802b338-d4ef-4326-886b-25e6c0cb7f1e tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-87a283db-04d8-46c2-bc23-7b1fd16f2b11-delete_volume" released by "delete_volume" :: held 3.953s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:39 devstack sudo[114791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.af74ce47-57df-4765-a3e9-f59d5b53d15f Jun 30 16:32:39 devstack sudo[114791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:39 devstack sudo[114783]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD" returned: 1 in 1.225s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:32:39 devstack sudo[114781]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] 81d21302-c82f-4f72-b4ce-82566782e3fe was raw, converting to raw {{(pid=93781) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-82fe6860-6ee3-4688-9a21-0d1a0d24106b tempest-CinderUnicodeTest-1746259110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d207a5fe-d2e6-441f-acc5-2b06dad1146c" returned: 0 in 1.261s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-82fe6860-6ee3-4688-9a21-0d1a0d24106b tempest-CinderUnicodeTest-1746259110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d207a5fe-d2e6-441f-acc5-2b06dad1146c {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:39 devstack sudo[114799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f Jun 30 16:32:39 devstack sudo[114799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:39 devstack sudo[114800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d207a5fe-d2e6-441f-acc5-2b06dad1146c Jun 30 16:32:39 devstack sudo[114800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:40 devstack sudo[114791]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d375c9c4-a07d-47ae-a72d-33e123ae2290 tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.af74ce47-57df-4765-a3e9-f59d5b53d15f" returned: 0 in 1.058s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-d375c9c4-a07d-47ae-a72d-33e123ae2290 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:32:40 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05eaa87-0b91-4b2a-a6c6-37c4b255d130]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d375c9c4-a07d-47ae-a72d-33e123ae2290 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:40 devstack sudo[114789]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-84b00af8-b92e-410e-af75-df96827a2ab8 1073741824" returned: 0 in 1.261s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-84b00af8-b92e-410e-af75-df96827a2ab8 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:40 devstack sudo[114815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-84b00af8-b92e-410e-af75-df96827a2ab8 Jun 30 16:32:40 devstack sudo[114815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:40 devstack sudo[114800]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-82fe6860-6ee3-4688-9a21-0d1a0d24106b tempest-CinderUnicodeTest-1746259110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-d207a5fe-d2e6-441f-acc5-2b06dad1146c" returned: 0 in 0.914s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:40 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-82fe6860-6ee3-4688-9a21-0d1a0d24106b tempest-CinderUnicodeTest-1746259110 None] Lock "cinder-quobyte-d207a5fe-d2e6-441f-acc5-2b06dad1146c" released by "delete_volume" :: held 2.254s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:40 devstack sudo[114799]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f" returned: 0 in 0.992s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:40 devstack sudo[114814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2 Jun 30 16:32:40 devstack sudo[114814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:40 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_81d21302-c82f-4f72-b4ce-82566782e3fe_cb_xii4zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:32:40 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Converted 0.00 MB image at 0.00 MB/s Jun 30 16:32:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:40 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-82fe6860-6ee3-4688-9a21-0d1a0d24106b tempest-CinderUnicodeTest-1746259110 None] Created reservations ['69c1d973-b4a6-4482-870c-b03c367641aa', 'bf3bee01-0d9f-4c4d-8acb-036e34eeae4a', 'f87a6286-799b-4364-8126-c5f89504b6fa', '8770c383-e712-4ca2-b4dd-9015c0235de2'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:32:40 devstack sudo[114818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f 1G Jun 30 16:32:40 devstack sudo[114818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-82fe6860-6ee3-4688-9a21-0d1a0d24106b tempest-CinderUnicodeTest-1746259110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-82fe6860-6ee3-4688-9a21-0d1a0d24106b tempest-CinderUnicodeTest-1746259110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-82fe6860-6ee3-4688-9a21-0d1a0d24106b tempest-CinderUnicodeTest-1746259110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-82fe6860-6ee3-4688-9a21-0d1a0d24106b tempest-CinderUnicodeTest-1746259110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-82fe6860-6ee3-4688-9a21-0d1a0d24106b tempest-CinderUnicodeTest-1746259110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-82fe6860-6ee3-4688-9a21-0d1a0d24106b tempest-CinderUnicodeTest-1746259110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:40 devstack sudo[114820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:32:40 devstack sudo[114820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:41 devstack sudo[114815]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-84b00af8-b92e-410e-af75-df96827a2ab8" returned: 0 in 0.771s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] <== create_volume: return (2097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.103s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.961s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-503738944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9558e1db-d44d-4076-850f-2dcf21d1039f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af72a5c81d1843509df5547f1d9e52ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:35Z,use_quota=True,user_id='bc031ec6aa954a55aadf1e01f46d0022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Creating volume 9558e1db-d44d-4076-850f-2dcf21d1039f {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:32:41 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9558e1db-d44d-4076-850f-2dcf21d1039f 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc2f24b-af01-406c-af26-ff4b26ff82d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84b00af8-b92e-410e-af75-df96827a2ab8', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:41 devstack sudo[114825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9558e1db-d44d-4076-850f-2dcf21d1039f 1073741824 Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf62be2-d939-4e37-b1c9-299fe77d260c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:41 devstack sudo[114825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:41 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Volume volume-84b00af8-b92e-410e-af75-df96827a2ab8 (84b00af8-b92e-410e-af75-df96827a2ab8): created successfully Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf62be2-d939-4e37-b1c9-299fe77d260c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Flow 'volume_create_manager' (abb3d7e7-140d-430c-a979-45bb2e3c14b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:41 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-ce33f213-c9a7-43c7-8fa5-86a5b2676f4b tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Created volume successfully. Jun 30 16:32:41 devstack sudo[114820]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-82fe6860-6ee3-4688-9a21-0d1a0d24106b tempest-CinderUnicodeTest-1746259110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.837s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-82fe6860-6ee3-4688-9a21-0d1a0d24106b tempest-CinderUnicodeTest-1746259110 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:32:41 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-82fe6860-6ee3-4688-9a21-0d1a0d24106b tempest-CinderUnicodeTest-1746259110 None] Deleted volume successfully. Jun 30 16:32:41 devstack sudo[114814]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d375c9c4-a07d-47ae-a72d-33e123ae2290 tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2" returned: 0 in 1.195s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d375c9c4-a07d-47ae-a72d-33e123ae2290 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.af74ce47-57df-4765-a3e9-f59d5b53d15f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-82fe6860-6ee3-4688-9a21-0d1a0d24106b tempest-CinderUnicodeTest-1746259110 None] Lock "cinder-d207a5fe-d2e6-441f-acc5-2b06dad1146c-delete_volume" released by "delete_volume" :: held 3.480s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:41 devstack sudo[114832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.af74ce47-57df-4765-a3e9-f59d5b53d15f Jun 30 16:32:41 devstack sudo[114832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:41 devstack sudo[114818]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f 1G" returned: 0 in 1.147s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcaf64d-e33e-4c19-8973-95cd592b90a8]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:42 devstack sudo[114834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f Jun 30 16:32:42 devstack sudo[114834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:42 devstack sudo[114825]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9558e1db-d44d-4076-850f-2dcf21d1039f 1073741824" returned: 0 in 1.228s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:42 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:UPDATE=168,cinder:SELECT=119,cinder:INSERT=53,cinder:DELETE=17 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:32:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9558e1db-d44d-4076-850f-2dcf21d1039f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:42 devstack sudo[114845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9558e1db-d44d-4076-850f-2dcf21d1039f Jun 30 16:32:42 devstack sudo[114845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:43 devstack sudo[114832]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d375c9c4-a07d-47ae-a72d-33e123ae2290 tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.af74ce47-57df-4765-a3e9-f59d5b53d15f" returned: 0 in 1.271s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d375c9c4-a07d-47ae-a72d-33e123ae2290 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.af74ce47-57df-4765-a3e9-f59d5b53d15f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:43 devstack sudo[114849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.af74ce47-57df-4765-a3e9-f59d5b53d15f Jun 30 16:32:43 devstack sudo[114849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:43 devstack sudo[114834]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f" returned: 0 in 1.249s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:43 devstack sudo[114851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f Jun 30 16:32:43 devstack sudo[114851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:43 devstack sudo[114845]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9558e1db-d44d-4076-850f-2dcf21d1039f" returned: 0 in 1.167s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:43 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] <== create_volume: return (2504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:32:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.513s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.788s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:43 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1455659644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac5a765-f87a-4ce3-99b7-f49fc7add867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af72a5c81d1843509df5547f1d9e52ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:36Z,use_quota=True,user_id='bc031ec6aa954a55aadf1e01f46d0022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:32:43 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Creating volume 0ac5a765-f87a-4ce3-99b7-f49fc7add867 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:32:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:43 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:43 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:43 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:32:43 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:32:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0ac5a765-f87a-4ce3-99b7-f49fc7add867 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=133,cinder:UPDATE=179,cinder:INSERT=36,cinder:DELETE=16 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d23a1bc9-5fad-44c9-961d-4c64c8b13ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9558e1db-d44d-4076-850f-2dcf21d1039f', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52033413-50cc-447f-8e12-cf14888769b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:44 devstack sudo[114855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0ac5a765-f87a-4ce3-99b7-f49fc7add867 1073741824 Jun 30 16:32:44 devstack sudo[114855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:44 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Volume volume-9558e1db-d44d-4076-850f-2dcf21d1039f (9558e1db-d44d-4076-850f-2dcf21d1039f): created successfully Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52033413-50cc-447f-8e12-cf14888769b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Flow 'volume_create_manager' (d82b287e-1a19-4e30-80c5-daa475e4b8ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:44 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-16802bbe-6c39-4991-8265-d04197c45b35 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Created volume successfully. Jun 30 16:32:44 devstack sudo[114849]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-d375c9c4-a07d-47ae-a72d-33e123ae2290 tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2.af74ce47-57df-4765-a3e9-f59d5b53d15f" returned: 0 in 1.075s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d375c9c4-a07d-47ae-a72d-33e123ae2290 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-quobyte-af74ce47-57df-4765-a3e9-f59d5b53d15f" released by "_delete_snapshot" :: held 4.822s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d375c9c4-a07d-47ae-a72d-33e123ae2290 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-quobyte-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2" released by "delete_snapshot" :: held 4.939s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-d375c9c4-a07d-47ae-a72d-33e123ae2290 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Created reservations ['21b9bafe-1617-422b-a7fd-f30488ccf23e', '63e4d2ba-0e1e-4875-a5b5-dc008fd5c8c6', '098d9983-d821-4a96-8382-ed31931fd4d0', 'f22d9b50-04fc-44c7-8b41-77fa20c0e973'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:32:44 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-d375c9c4-a07d-47ae-a72d-33e123ae2290 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Delete snapshot completed successfully. Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-d375c9c4-a07d-47ae-a72d-33e123ae2290 tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-af74ce47-57df-4765-a3e9-f59d5b53d15f-delete_snapshot" released by "delete_snapshot" :: held 5.217s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:44 devstack sudo[114851]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f" returned: 1 in 1.406s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Downloaded image 81d21302-c82f-4f72-b4ce-82566782e3fe ((None, [{'url': 'file:///opt/stack/data/glance/images/81d21302-c82f-4f72-b4ce-82566782e3fe', 'metadata': {}}])) to volume 33d0772d-b4ce-4540-897e-8fa4479c0a8f successfully. {{(pid=93781) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Temporary image 81d21302-c82f-4f72-b4ce-82566782e3fe for user f6515bfe1e3c4d079bda5e56dca387ec is deleted. {{(pid=93781) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG cinder.volume.volume_utils [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Marking volume 33d0772d-b4ce-4540-897e-8fa4479c0a8f as bootable. {{(pid=93781) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Copying metadata from image 81d21302-c82f-4f72-b4ce-82566782e3fe to 33d0772d-b4ce-4540-897e-8fa4479c0a8f. {{(pid=93781) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Creating volume glance metadata for volume 33d0772d-b4ce-4540-897e-8fa4479c0a8f backed by image 81d21302-c82f-4f72-b4ce-82566782e3fe with: {'image_id': '81d21302-c82f-4f72-b4ce-82566782e3fe', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b83bea7dbe9cdf7cd8b47610a1b7e236', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93781) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f59cb560-1fea-4e6d-98dd-4f5c55625b3f tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "cinder-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f59cb560-1fea-4e6d-98dd-4f5c55625b3f tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f455758b-5d0c-48a9-9225-8cf76bf7b6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f', 'volume_size': 1, 'image_id': '81d21302-c82f-4f72-b4ce-82566782e3fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/81d21302-c82f-4f72-b4ce-82566782e3fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b83bea7dbe9cdf7cd8b47610a1b7e236', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '57cc283aea8c465a86e9cd2c2ad1a013', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '44027525de067866dbf01e9d7f0e4b741acf275286ba5643e95476db5fa37b441b80162edd180e7b9a778d56da4279860f47c02348acd9d9dfaecd9654d1c56c', 'id': '81d21302-c82f-4f72-b4ce-82566782e3fe', 'created_at': datetime.datetime(2026, 6, 30, 14, 32, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 30, 14, 32, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/81d21302-c82f-4f72-b4ce-82566782e3fe/file', 'properties': {}}, 'image_service': }' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebbdbc36-d1ae-4d50-9f1d-bcf5956758b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f59cb560-1fea-4e6d-98dd-4f5c55625b3f tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "cinder-quobyte-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:44 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Volume volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f (33d0772d-b4ce-4540-897e-8fa4479c0a8f): created successfully Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebbdbc36-d1ae-4d50-9f1d-bcf5956758b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Flow 'volume_create_manager' (f9d890e4-589e-4022-9a7f-4b26a0f4cdff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f59cb560-1fea-4e6d-98dd-4f5c55625b3f tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-quobyte-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2" acquired by "delete_volume" :: waited 0.030s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:44 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-86b741e2-61dc-4c7f-bdc5-9ccbf6df6717 tempest-VolumeImageDependencyTests-900479708 None] Created volume successfully. Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[8528cb0c-60ef-423f-a35d-84f7de277035]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f59cb560-1fea-4e6d-98dd-4f5c55625b3f tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:45 devstack sudo[114860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2 Jun 30 16:32:45 devstack sudo[114860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:45 devstack sudo[114855]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0ac5a765-f87a-4ce3-99b7-f49fc7add867 1073741824" returned: 0 in 1.490s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7a1e9b3a-4528-4e18-8b95-0429c1fc8b3b tempest-VolumeImageDependencyTests-900479708 None] Acquiring lock "cinder-33d0772d-b4ce-4540-897e-8fa4479c0a8f-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0ac5a765-f87a-4ce3-99b7-f49fc7add867 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7a1e9b3a-4528-4e18-8b95-0429c1fc8b3b tempest-VolumeImageDependencyTests-900479708 None] Lock "cinder-33d0772d-b4ce-4540-897e-8fa4479c0a8f-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:45 devstack sudo[114872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0ac5a765-f87a-4ce3-99b7-f49fc7add867 Jun 30 16:32:45 devstack sudo[114872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7a1e9b3a-4528-4e18-8b95-0429c1fc8b3b tempest-VolumeImageDependencyTests-900479708 None] Acquiring lock "cinder-quobyte-33d0772d-b4ce-4540-897e-8fa4479c0a8f" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7a1e9b3a-4528-4e18-8b95-0429c1fc8b3b tempest-VolumeImageDependencyTests-900479708 None] Lock "cinder-quobyte-33d0772d-b4ce-4540-897e-8fa4479c0a8f" acquired by "delete_volume" :: waited 0.018s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:45 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09d007c-122f-403a-aee7-1aa3cbeb4ba0]: (4, 'raw') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7a1e9b3a-4528-4e18-8b95-0429c1fc8b3b tempest-VolumeImageDependencyTests-900479708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:45 devstack sudo[114878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f Jun 30 16:32:45 devstack sudo[114878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:45 devstack sudo[114860]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f59cb560-1fea-4e6d-98dd-4f5c55625b3f tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2" returned: 0 in 1.097s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f59cb560-1fea-4e6d-98dd-4f5c55625b3f tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:46 devstack sudo[114880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2 Jun 30 16:32:46 devstack sudo[114880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:46 devstack sudo[114872]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0ac5a765-f87a-4ce3-99b7-f49fc7add867" returned: 0 in 1.045s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:46 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] <== create_volume: return (2677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:32:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.692s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa3cb96-8115-4d43-920d-322fd7c279d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ac5a765-f87a-4ce3-99b7-f49fc7add867', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41006c9b-4dbe-4987-afa6-543ba26da8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:46 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Volume volume-0ac5a765-f87a-4ce3-99b7-f49fc7add867 (0ac5a765-f87a-4ce3-99b7-f49fc7add867): created successfully Jun 30 16:32:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41006c9b-4dbe-4987-afa6-543ba26da8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:46 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Flow 'volume_create_manager' (341f785c-3ad0-47b4-98bd-ade67902b0fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:46 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-80ee78c2-b190-409b-9f3d-dfa3642775e8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Created volume successfully. Jun 30 16:32:46 devstack sudo[114878]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7a1e9b3a-4528-4e18-8b95-0429c1fc8b3b tempest-VolumeImageDependencyTests-900479708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f" returned: 0 in 1.074s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7a1e9b3a-4528-4e18-8b95-0429c1fc8b3b tempest-VolumeImageDependencyTests-900479708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:46 devstack sudo[114885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f Jun 30 16:32:46 devstack sudo[114885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:47 devstack sudo[114880]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f59cb560-1fea-4e6d-98dd-4f5c55625b3f tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2" returned: 0 in 1.180s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:47 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f59cb560-1fea-4e6d-98dd-4f5c55625b3f tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-quobyte-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2" released by "delete_volume" :: held 2.370s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:47 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-f59cb560-1fea-4e6d-98dd-4f5c55625b3f tempest-CreateVolumesFromSnapshotTest-2056289189 None] Created reservations ['854f1ac6-c51a-4b45-a2d8-51692987c6ed', '5d2621a1-344f-45c1-9726-7bfefef58966', '50a0c4c5-371b-4ac8-8ca1-05b4923a4fbf', '535f2398-777c-499a-bd93-6f3f1edfff34'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:32:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f59cb560-1fea-4e6d-98dd-4f5c55625b3f tempest-CreateVolumesFromSnapshotTest-2056289189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f59cb560-1fea-4e6d-98dd-4f5c55625b3f tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f59cb560-1fea-4e6d-98dd-4f5c55625b3f tempest-CreateVolumesFromSnapshotTest-2056289189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:47 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f59cb560-1fea-4e6d-98dd-4f5c55625b3f tempest-CreateVolumesFromSnapshotTest-2056289189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f59cb560-1fea-4e6d-98dd-4f5c55625b3f tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f59cb560-1fea-4e6d-98dd-4f5c55625b3f tempest-CreateVolumesFromSnapshotTest-2056289189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:47 devstack sudo[114889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:32:47 devstack sudo[114889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:47 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8d7bc6f4-39f6-404c-9484-b71d582a2c08 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "cinder-0ac5a765-f87a-4ce3-99b7-f49fc7add867-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:47 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8d7bc6f4-39f6-404c-9484-b71d582a2c08 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-0ac5a765-f87a-4ce3-99b7-f49fc7add867-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:47 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8d7bc6f4-39f6-404c-9484-b71d582a2c08 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "cinder-quobyte-0ac5a765-f87a-4ce3-99b7-f49fc7add867" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:47 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8d7bc6f4-39f6-404c-9484-b71d582a2c08 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-quobyte-0ac5a765-f87a-4ce3-99b7-f49fc7add867" acquired by "delete_volume" :: waited 0.027s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:47 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7191c0-07b4-4ce4-b6a2-2d534debc432]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8d7bc6f4-39f6-404c-9484-b71d582a2c08 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0ac5a765-f87a-4ce3-99b7-f49fc7add867 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:48 devstack sudo[114891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0ac5a765-f87a-4ce3-99b7-f49fc7add867 Jun 30 16:32:48 devstack sudo[114891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:48 devstack sudo[114885]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7a1e9b3a-4528-4e18-8b95-0429c1fc8b3b tempest-VolumeImageDependencyTests-900479708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f" returned: 1 in 1.372s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7a1e9b3a-4528-4e18-8b95-0429c1fc8b3b tempest-VolumeImageDependencyTests-900479708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f' failed. Not Retrying. {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 30 16:32:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7a1e9b3a-4528-4e18-8b95-0429c1fc8b3b tempest-VolumeImageDependencyTests-900479708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:48 devstack sudo[114896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f Jun 30 16:32:48 devstack sudo[114896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:48 devstack sudo[114889]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f59cb560-1fea-4e6d-98dd-4f5c55625b3f tempest-CreateVolumesFromSnapshotTest-2056289189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.154s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:48 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-f59cb560-1fea-4e6d-98dd-4f5c55625b3f tempest-CreateVolumesFromSnapshotTest-2056289189 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:32:48 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-f59cb560-1fea-4e6d-98dd-4f5c55625b3f tempest-CreateVolumesFromSnapshotTest-2056289189 None] Deleted volume successfully. Jun 30 16:32:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f59cb560-1fea-4e6d-98dd-4f5c55625b3f tempest-CreateVolumesFromSnapshotTest-2056289189 None] Lock "cinder-3598fe2d-9cb2-4307-b7a8-b900a1fbc7d2-delete_volume" released by "delete_volume" :: held 3.917s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:49 devstack sudo[114896]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7a1e9b3a-4528-4e18-8b95-0429c1fc8b3b tempest-VolumeImageDependencyTests-900479708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-33d0772d-b4ce-4540-897e-8fa4479c0a8f" returned: 0 in 0.948s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:49 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7a1e9b3a-4528-4e18-8b95-0429c1fc8b3b tempest-VolumeImageDependencyTests-900479708 None] Lock "cinder-quobyte-33d0772d-b4ce-4540-897e-8fa4479c0a8f" released by "delete_volume" :: held 3.513s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:49 devstack sudo[114891]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8d7bc6f4-39f6-404c-9484-b71d582a2c08 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0ac5a765-f87a-4ce3-99b7-f49fc7add867" returned: 0 in 1.403s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8d7bc6f4-39f6-404c-9484-b71d582a2c08 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0ac5a765-f87a-4ce3-99b7-f49fc7add867 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:49 devstack sudo[114903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0ac5a765-f87a-4ce3-99b7-f49fc7add867 Jun 30 16:32:49 devstack sudo[114903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:49 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-7a1e9b3a-4528-4e18-8b95-0429c1fc8b3b tempest-VolumeImageDependencyTests-900479708 None] Created reservations ['b5b04d6f-f04a-4677-be9d-ad540fd5df06', '8c12d887-1080-43b6-83f9-12d39815caf8', '3c081e31-6e7f-4226-a0b5-aa3657c7da20', '2b3fb352-ec69-4413-ba38-04ff2360d34b'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:32:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7a1e9b3a-4528-4e18-8b95-0429c1fc8b3b tempest-VolumeImageDependencyTests-900479708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7a1e9b3a-4528-4e18-8b95-0429c1fc8b3b tempest-VolumeImageDependencyTests-900479708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-7a1e9b3a-4528-4e18-8b95-0429c1fc8b3b tempest-VolumeImageDependencyTests-900479708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:49 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-7a1e9b3a-4528-4e18-8b95-0429c1fc8b3b tempest-VolumeImageDependencyTests-900479708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7a1e9b3a-4528-4e18-8b95-0429c1fc8b3b tempest-VolumeImageDependencyTests-900479708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7a1e9b3a-4528-4e18-8b95-0429c1fc8b3b tempest-VolumeImageDependencyTests-900479708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:49 devstack sudo[114905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:32:49 devstack sudo[114905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:50 devstack sudo[114903]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8d7bc6f4-39f6-404c-9484-b71d582a2c08 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-0ac5a765-f87a-4ce3-99b7-f49fc7add867" returned: 0 in 1.160s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8d7bc6f4-39f6-404c-9484-b71d582a2c08 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-quobyte-0ac5a765-f87a-4ce3-99b7-f49fc7add867" released by "delete_volume" :: held 2.660s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:50 devstack sudo[114905]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7a1e9b3a-4528-4e18-8b95-0429c1fc8b3b tempest-VolumeImageDependencyTests-900479708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.091s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:50 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-7a1e9b3a-4528-4e18-8b95-0429c1fc8b3b tempest-VolumeImageDependencyTests-900479708 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:32:50 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-7a1e9b3a-4528-4e18-8b95-0429c1fc8b3b tempest-VolumeImageDependencyTests-900479708 None] Deleted volume successfully. Jun 30 16:32:50 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7a1e9b3a-4528-4e18-8b95-0429c1fc8b3b tempest-VolumeImageDependencyTests-900479708 None] Lock "cinder-33d0772d-b4ce-4540-897e-8fa4479c0a8f-delete_volume" released by "delete_volume" :: held 4.961s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:50 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-8d7bc6f4-39f6-404c-9484-b71d582a2c08 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Created reservations ['c27f53b8-69f4-4af2-a7b6-5034de9e0337', 'ccd27a98-94a4-46cc-b61f-e81330ead0f0', 'f5ebfcdb-d7f9-467b-9f9f-42f50e4ad49b', '5c6c82ab-4d9b-46a9-a213-7491b03a8b6e'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:32:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8d7bc6f4-39f6-404c-9484-b71d582a2c08 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8d7bc6f4-39f6-404c-9484-b71d582a2c08 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:50 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-8d7bc6f4-39f6-404c-9484-b71d582a2c08 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:50 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-8d7bc6f4-39f6-404c-9484-b71d582a2c08 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-8d7bc6f4-39f6-404c-9484-b71d582a2c08 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:50 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8d7bc6f4-39f6-404c-9484-b71d582a2c08 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:50 devstack sudo[114909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:32:50 devstack sudo[114909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:51 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cd67c9d3-cf1f-4f82-bf4e-ce0dcb011c74 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "cinder-9558e1db-d44d-4076-850f-2dcf21d1039f-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:51 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cd67c9d3-cf1f-4f82-bf4e-ce0dcb011c74 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-9558e1db-d44d-4076-850f-2dcf21d1039f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:51 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cd67c9d3-cf1f-4f82-bf4e-ce0dcb011c74 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "cinder-quobyte-9558e1db-d44d-4076-850f-2dcf21d1039f" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:51 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cd67c9d3-cf1f-4f82-bf4e-ce0dcb011c74 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-quobyte-9558e1db-d44d-4076-850f-2dcf21d1039f" acquired by "delete_volume" :: waited 0.032s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:51 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccc2d7f-a43f-4584-a46f-7e8009feea98]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd67c9d3-cf1f-4f82-bf4e-ce0dcb011c74 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9558e1db-d44d-4076-850f-2dcf21d1039f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:51 devstack sudo[114911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9558e1db-d44d-4076-850f-2dcf21d1039f Jun 30 16:32:51 devstack sudo[114911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:51 devstack sudo[114909]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:51 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-8d7bc6f4-39f6-404c-9484-b71d582a2c08 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.043s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:51 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-8d7bc6f4-39f6-404c-9484-b71d582a2c08 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:32:51 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-8d7bc6f4-39f6-404c-9484-b71d582a2c08 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Deleted volume successfully. Jun 30 16:32:51 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-8d7bc6f4-39f6-404c-9484-b71d582a2c08 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-0ac5a765-f87a-4ce3-99b7-f49fc7add867-delete_volume" released by "delete_volume" :: held 4.249s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:53 devstack sudo[114911]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd67c9d3-cf1f-4f82-bf4e-ce0dcb011c74 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9558e1db-d44d-4076-850f-2dcf21d1039f" returned: 0 in 1.504s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd67c9d3-cf1f-4f82-bf4e-ce0dcb011c74 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9558e1db-d44d-4076-850f-2dcf21d1039f {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:53 devstack sudo[114917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9558e1db-d44d-4076-850f-2dcf21d1039f Jun 30 16:32:53 devstack sudo[114917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Flow 'volume_create_manager' (c3a71f63-89ea-438c-9ec4-b98a2bf9f342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3b1aac-9473-4840-819c-ae5a7eaf8d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3b1aac-9473-4840-819c-ae5a7eaf8d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1988499775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6fb45af-dec2-4b17-8486-7fc0c5f8dacb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea22847eca4144d89a76dd3f21828d4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:53Z,use_quota=True,user_id='35eb9b3d674b4ad9895a5c770623ba33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a782b1aa-c2b3-4998-8a6a-73258fbf3db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a782b1aa-c2b3-4998-8a6a-73258fbf3db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6f6066-cff3-4290-983c-eca80380edf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6f6066-cff3-4290-983c-eca80380edf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6fb45af-dec2-4b17-8486-7fc0c5f8dacb', 'volume_name': 'volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326cfff3-7bce-4dbe-880a-748667c93cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326cfff3-7bce-4dbe-880a-748667c93cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c172c683-ca4e-4cb9-8ea0-630f401d2440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:53 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Volume b6fb45af-dec2-4b17-8486-7fc0c5f8dacb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb', 'volume_size': 1} Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1988499775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6fb45af-dec2-4b17-8486-7fc0c5f8dacb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea22847eca4144d89a76dd3f21828d4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:32:53Z,use_quota=True,user_id='35eb9b3d674b4ad9895a5c770623ba33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Creating volume b6fb45af-dec2-4b17-8486-7fc0c5f8dacb {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:32:53 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:32:53 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:53 devstack sudo[114919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb 1073741824 Jun 30 16:32:53 devstack sudo[114919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:54 devstack sudo[114917]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd67c9d3-cf1f-4f82-bf4e-ce0dcb011c74 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-9558e1db-d44d-4076-850f-2dcf21d1039f" returned: 0 in 1.182s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cd67c9d3-cf1f-4f82-bf4e-ce0dcb011c74 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-quobyte-9558e1db-d44d-4076-850f-2dcf21d1039f" released by "delete_volume" :: held 2.789s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:54 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-cd67c9d3-cf1f-4f82-bf4e-ce0dcb011c74 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Created reservations ['f6844aef-a786-407f-8c57-92b5d58efc64', 'a53ddbef-45a0-4fee-a9fa-2a8545b35bfb', '2edc0754-9e49-426e-bfe6-5fd151b061be', '43156b03-a715-4073-b5ea-8f831668fa5d'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:32:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cd67c9d3-cf1f-4f82-bf4e-ce0dcb011c74 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cd67c9d3-cf1f-4f82-bf4e-ce0dcb011c74 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cd67c9d3-cf1f-4f82-bf4e-ce0dcb011c74 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:54 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-cd67c9d3-cf1f-4f82-bf4e-ce0dcb011c74 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-cd67c9d3-cf1f-4f82-bf4e-ce0dcb011c74 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd67c9d3-cf1f-4f82-bf4e-ce0dcb011c74 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:54 devstack sudo[114924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:32:54 devstack sudo[114924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2edd7639-3207-47f0-8663-97c467553905 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "cinder-84b00af8-b92e-410e-af75-df96827a2ab8-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2edd7639-3207-47f0-8663-97c467553905 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-84b00af8-b92e-410e-af75-df96827a2ab8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2edd7639-3207-47f0-8663-97c467553905 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "cinder-quobyte-84b00af8-b92e-410e-af75-df96827a2ab8" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb 1073741824" returned: 0 in 1.149s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:54 devstack sudo[114919]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:54 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2edd7639-3207-47f0-8663-97c467553905 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-quobyte-84b00af8-b92e-410e-af75-df96827a2ab8" acquired by "delete_volume" :: waited 0.059s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:54 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff0913b-9328-47e1-b345-b6599f86e453]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:54 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2edd7639-3207-47f0-8663-97c467553905 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-84b00af8-b92e-410e-af75-df96827a2ab8 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:55 devstack sudo[114929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb Jun 30 16:32:55 devstack sudo[114929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:55 devstack sudo[114928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-84b00af8-b92e-410e-af75-df96827a2ab8 Jun 30 16:32:55 devstack sudo[114928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:55 devstack sudo[114924]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:55 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-cd67c9d3-cf1f-4f82-bf4e-ce0dcb011c74 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.087s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:55 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-cd67c9d3-cf1f-4f82-bf4e-ce0dcb011c74 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:32:55 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-cd67c9d3-cf1f-4f82-bf4e-ce0dcb011c74 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Deleted volume successfully. Jun 30 16:32:55 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-cd67c9d3-cf1f-4f82-bf4e-ce0dcb011c74 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-9558e1db-d44d-4076-850f-2dcf21d1039f-delete_volume" released by "delete_volume" :: held 4.274s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:56 devstack sudo[114929]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb" returned: 0 in 1.094s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:56 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] <== create_volume: return (2428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:32:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.432s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c172c683-ca4e-4cb9-8ea0-630f401d2440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd36b3a7-148d-49fe-a0b1-06eb5fd240aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:32:56 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Volume volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb (b6fb45af-dec2-4b17-8486-7fc0c5f8dacb): created successfully Jun 30 16:32:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd36b3a7-148d-49fe-a0b1-06eb5fd240aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:32:56 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Flow 'volume_create_manager' (c3a71f63-89ea-438c-9ec4-b98a2bf9f342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:32:56 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-9ebe08e6-144f-4ffe-aea4-982ff840fb58 tempest-VolumeDependencyTests-1618039585 None] Created volume successfully. Jun 30 16:32:56 devstack sudo[114928]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2edd7639-3207-47f0-8663-97c467553905 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-84b00af8-b92e-410e-af75-df96827a2ab8" returned: 0 in 1.432s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2edd7639-3207-47f0-8663-97c467553905 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-84b00af8-b92e-410e-af75-df96827a2ab8 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:56 devstack sudo[114939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-84b00af8-b92e-410e-af75-df96827a2ab8 Jun 30 16:32:56 devstack sudo[114939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2d7f74e6-9553-41f8-8961-1643422d9503 tempest-VolumeDependencyTests-1618039585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2d7f74e6-9553-41f8-8961-1643422d9503 tempest-VolumeDependencyTests-1618039585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:56 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-2d7f74e6-9553-41f8-8961-1643422d9503 tempest-VolumeDependencyTests-1618039585 None] Creating offline snapshot 509c3939-1868-4c77-82f8-ea7b44b9f7a3 of volume b6fb45af-dec2-4b17-8486-7fc0c5f8dacb {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:32:56 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[b980907b-ea8e-460d-8ac9-36560f5d0f9d]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:56 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2d7f74e6-9553-41f8-8961-1643422d9503 tempest-VolumeDependencyTests-1618039585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:57 devstack sudo[114941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb Jun 30 16:32:57 devstack sudo[114941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:57 devstack sudo[114939]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2edd7639-3207-47f0-8663-97c467553905 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-84b00af8-b92e-410e-af75-df96827a2ab8" returned: 0 in 0.868s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:57 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2edd7639-3207-47f0-8663-97c467553905 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-quobyte-84b00af8-b92e-410e-af75-df96827a2ab8" released by "delete_volume" :: held 2.395s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:57 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-2edd7639-3207-47f0-8663-97c467553905 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Created reservations ['26f3b7bd-eba9-4816-be2b-d17434acc94b', '5972ebc6-86ed-4ebc-b5fd-d8a38c1f6524', 'dbc56a69-1454-48cd-9af2-cdc4fc4738dd', 'ca7d627b-0ff9-4829-a6ef-17b2c4eda7b3'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:32:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2edd7639-3207-47f0-8663-97c467553905 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:32:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2edd7639-3207-47f0-8663-97c467553905 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:32:57 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-2edd7639-3207-47f0-8663-97c467553905 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:32:57 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-2edd7639-3207-47f0-8663-97c467553905 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:32:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2edd7639-3207-47f0-8663-97c467553905 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:32:57 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2edd7639-3207-47f0-8663-97c467553905 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:57 devstack sudo[114945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:32:57 devstack sudo[114945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:57 devstack sudo[114941]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2d7f74e6-9553-41f8-8961-1643422d9503 tempest-VolumeDependencyTests-1618039585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb" returned: 0 in 1.028s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2d7f74e6-9553-41f8-8961-1643422d9503 tempest-VolumeDependencyTests-1618039585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.509c3939-1868-4c77-82f8-ea7b44b9f7a3 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:58 devstack sudo[114950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.509c3939-1868-4c77-82f8-ea7b44b9f7a3 1G Jun 30 16:32:58 devstack sudo[114950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:58 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7c697303-707b-424f-95ac-aa2916a24234 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "cinder-f3cdd3c4-f62a-4a83-83fd-b1a2b842727b-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:58 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7c697303-707b-424f-95ac-aa2916a24234 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-f3cdd3c4-f62a-4a83-83fd-b1a2b842727b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:58 devstack sudo[114945]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2edd7639-3207-47f0-8663-97c467553905 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.870s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:58 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-2edd7639-3207-47f0-8663-97c467553905 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:32:58 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-2edd7639-3207-47f0-8663-97c467553905 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Deleted volume successfully. Jun 30 16:32:58 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7c697303-707b-424f-95ac-aa2916a24234 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "cinder-quobyte-f3cdd3c4-f62a-4a83-83fd-b1a2b842727b" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:32:58 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7c697303-707b-424f-95ac-aa2916a24234 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-quobyte-f3cdd3c4-f62a-4a83-83fd-b1a2b842727b" acquired by "delete_volume" :: waited 0.048s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:32:58 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-2edd7639-3207-47f0-8663-97c467553905 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-84b00af8-b92e-410e-af75-df96827a2ab8-delete_volume" released by "delete_volume" :: held 3.737s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:32:58 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bb9e0b-1c88-496f-b130-2d9021f8ecbf]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:32:58 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7c697303-707b-424f-95ac-aa2916a24234 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f3cdd3c4-f62a-4a83-83fd-b1a2b842727b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:58 devstack sudo[114953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f3cdd3c4-f62a-4a83-83fd-b1a2b842727b Jun 30 16:32:58 devstack sudo[114953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:59 devstack sudo[114950]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2d7f74e6-9553-41f8-8961-1643422d9503 tempest-VolumeDependencyTests-1618039585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.509c3939-1868-4c77-82f8-ea7b44b9f7a3 1G" returned: 0 in 1.336s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2d7f74e6-9553-41f8-8961-1643422d9503 tempest-VolumeDependencyTests-1618039585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.509c3939-1868-4c77-82f8-ea7b44b9f7a3 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:59 devstack sudo[114961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.509c3939-1868-4c77-82f8-ea7b44b9f7a3 Jun 30 16:32:59 devstack sudo[114961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:32:59 devstack sudo[114953]: pam_unix(sudo:session): session closed for user root Jun 30 16:32:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7c697303-707b-424f-95ac-aa2916a24234 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f3cdd3c4-f62a-4a83-83fd-b1a2b842727b" returned: 0 in 1.046s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:32:59 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7c697303-707b-424f-95ac-aa2916a24234 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f3cdd3c4-f62a-4a83-83fd-b1a2b842727b {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:32:59 devstack sudo[114965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f3cdd3c4-f62a-4a83-83fd-b1a2b842727b Jun 30 16:32:59 devstack sudo[114965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:00 devstack sudo[114961]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2d7f74e6-9553-41f8-8961-1643422d9503 tempest-VolumeDependencyTests-1618039585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.509c3939-1868-4c77-82f8-ea7b44b9f7a3" returned: 0 in 0.920s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:00 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-2d7f74e6-9553-41f8-8961-1643422d9503 tempest-VolumeDependencyTests-1618039585 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.509c3939-1868-4c77-82f8-ea7b44b9f7a3 is being set with open permissions: ugo+rw Jun 30 16:33:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2d7f74e6-9553-41f8-8961-1643422d9503 tempest-VolumeDependencyTests-1618039585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.509c3939-1868-4c77-82f8-ea7b44b9f7a3 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:00 devstack sudo[114971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.509c3939-1868-4c77-82f8-ea7b44b9f7a3 Jun 30 16:33:00 devstack sudo[114971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:00 devstack sudo[114965]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7c697303-707b-424f-95ac-aa2916a24234 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f3cdd3c4-f62a-4a83-83fd-b1a2b842727b" returned: 0 in 0.789s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7c697303-707b-424f-95ac-aa2916a24234 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-quobyte-f3cdd3c4-f62a-4a83-83fd-b1a2b842727b" released by "delete_volume" :: held 1.936s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:00 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-7c697303-707b-424f-95ac-aa2916a24234 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Created reservations ['1be76be5-1cf9-45a9-845a-ca7f24f37bbf', 'd273727e-a5d2-4ae4-9e9e-80b23ec86a44', '971faab9-c568-406a-a02c-c1b4fd41eca4', '79c09e00-6de6-40a8-85fe-2450dabeec3b'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:33:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7c697303-707b-424f-95ac-aa2916a24234 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:33:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7c697303-707b-424f-95ac-aa2916a24234 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:33:00 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-7c697303-707b-424f-95ac-aa2916a24234 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:33:00 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-7c697303-707b-424f-95ac-aa2916a24234 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:33:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-7c697303-707b-424f-95ac-aa2916a24234 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:33:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7c697303-707b-424f-95ac-aa2916a24234 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:00 devstack sudo[114973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:33:00 devstack sudo[114973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-12c48462-7905-47f9-a1ab-7755d8ee5be8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "cinder-b69ec689-ab6c-46a4-872e-4de774338258-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:33:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-12c48462-7905-47f9-a1ab-7755d8ee5be8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-b69ec689-ab6c-46a4-872e-4de774338258-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:33:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-12c48462-7905-47f9-a1ab-7755d8ee5be8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "cinder-quobyte-b69ec689-ab6c-46a4-872e-4de774338258" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:33:00 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-12c48462-7905-47f9-a1ab-7755d8ee5be8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-quobyte-b69ec689-ab6c-46a4-872e-4de774338258" acquired by "delete_volume" :: waited 0.019s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:33:00 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b28550c-e18d-4f8e-99de-69f37bae0d06]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:33:00 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-12c48462-7905-47f9-a1ab-7755d8ee5be8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b69ec689-ab6c-46a4-872e-4de774338258 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:01 devstack sudo[114975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b69ec689-ab6c-46a4-872e-4de774338258 Jun 30 16:33:01 devstack sudo[114975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:01 devstack sudo[114971]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2d7f74e6-9553-41f8-8961-1643422d9503 tempest-VolumeDependencyTests-1618039585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.509c3939-1868-4c77-82f8-ea7b44b9f7a3" returned: 0 in 1.056s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2d7f74e6-9553-41f8-8961-1643422d9503 tempest-VolumeDependencyTests-1618039585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:01 devstack sudo[114978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.info Jun 30 16:33:01 devstack sudo[114978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:01 devstack sudo[114973]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-7c697303-707b-424f-95ac-aa2916a24234 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.066s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:01 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-7c697303-707b-424f-95ac-aa2916a24234 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:33:01 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-7c697303-707b-424f-95ac-aa2916a24234 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Deleted volume successfully. Jun 30 16:33:01 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-7c697303-707b-424f-95ac-aa2916a24234 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-f3cdd3c4-f62a-4a83-83fd-b1a2b842727b-delete_volume" released by "delete_volume" :: held 3.400s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:01 devstack sudo[114975]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-12c48462-7905-47f9-a1ab-7755d8ee5be8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b69ec689-ab6c-46a4-872e-4de774338258" returned: 0 in 0.939s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:01 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-12c48462-7905-47f9-a1ab-7755d8ee5be8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b69ec689-ab6c-46a4-872e-4de774338258 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:01 devstack sudo[114984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b69ec689-ab6c-46a4-872e-4de774338258 Jun 30 16:33:01 devstack sudo[114984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:02 devstack sudo[114978]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2d7f74e6-9553-41f8-8961-1643422d9503 tempest-VolumeDependencyTests-1618039585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.info" returned: 0 in 0.917s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:02 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-2d7f74e6-9553-41f8-8961-1643422d9503 tempest-VolumeDependencyTests-1618039585 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.info is being set with open permissions: ugo+rw Jun 30 16:33:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2d7f74e6-9553-41f8-8961-1643422d9503 tempest-VolumeDependencyTests-1618039585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:02 devstack sudo[114987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.info Jun 30 16:33:02 devstack sudo[114987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:02 devstack sudo[114984]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:02 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-12c48462-7905-47f9-a1ab-7755d8ee5be8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b69ec689-ab6c-46a4-872e-4de774338258" returned: 0 in 0.907s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:02 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-12c48462-7905-47f9-a1ab-7755d8ee5be8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-quobyte-b69ec689-ab6c-46a4-872e-4de774338258" released by "delete_volume" :: held 1.916s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:02 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-12c48462-7905-47f9-a1ab-7755d8ee5be8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Created reservations ['fd276759-4e59-4f9e-8c81-9a4da1372045', '093121fb-22fe-403e-84e4-674045bb3b35', 'fbc282c9-e1b8-40f6-8f7a-62fbe4f4457a', 'ca786094-2323-4f73-8836-915297899718'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:33:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-12c48462-7905-47f9-a1ab-7755d8ee5be8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:33:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-12c48462-7905-47f9-a1ab-7755d8ee5be8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:33:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-12c48462-7905-47f9-a1ab-7755d8ee5be8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:33:03 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-12c48462-7905-47f9-a1ab-7755d8ee5be8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:33:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-12c48462-7905-47f9-a1ab-7755d8ee5be8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:33:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-12c48462-7905-47f9-a1ab-7755d8ee5be8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:03 devstack sudo[114992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:33:03 devstack sudo[114992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:03 devstack sudo[114987]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-2d7f74e6-9553-41f8-8961-1643422d9503 tempest-VolumeDependencyTests-1618039585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.info" returned: 0 in 0.950s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:03 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-2d7f74e6-9553-41f8-8961-1643422d9503 tempest-VolumeDependencyTests-1618039585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.356s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:33:03 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-2d7f74e6-9553-41f8-8961-1643422d9503 tempest-VolumeDependencyTests-1618039585 None] Create snapshot completed successfully Jun 30 16:33:04 devstack sudo[114992]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-12c48462-7905-47f9-a1ab-7755d8ee5be8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.885s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:04 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-12c48462-7905-47f9-a1ab-7755d8ee5be8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:33:04 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-12c48462-7905-47f9-a1ab-7755d8ee5be8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Deleted volume successfully. Jun 30 16:33:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-12c48462-7905-47f9-a1ab-7755d8ee5be8 tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-b69ec689-ab6c-46a4-872e-4de774338258-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-47eda914-cc64-4e96-8ac3-af29e07bf72a tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "cinder-c94a62c7-e3fc-4a58-b81b-e02291216bbc-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:33:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-47eda914-cc64-4e96-8ac3-af29e07bf72a tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-c94a62c7-e3fc-4a58-b81b-e02291216bbc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:33:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-47eda914-cc64-4e96-8ac3-af29e07bf72a tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "cinder-quobyte-c94a62c7-e3fc-4a58-b81b-e02291216bbc" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:33:04 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-47eda914-cc64-4e96-8ac3-af29e07bf72a tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-quobyte-c94a62c7-e3fc-4a58-b81b-e02291216bbc" acquired by "delete_volume" :: waited 0.015s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:33:04 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c49510-c994-488b-a591-181baa52d0e5]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:33:04 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-47eda914-cc64-4e96-8ac3-af29e07bf72a tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c94a62c7-e3fc-4a58-b81b-e02291216bbc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:04 devstack sudo[114995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c94a62c7-e3fc-4a58-b81b-e02291216bbc Jun 30 16:33:04 devstack sudo[114995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Flow 'volume_create_manager' (dfb43ec7-4a5b-43c5-ae78-3c9b3b114dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbcc24e6-5c77-4d90-9f71-e18a1d0029b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbcc24e6-5c77-4d90-9f71-e18a1d0029b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-850391598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7f8a4c-b992-4c53-953e-4da3326b68e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea22847eca4144d89a76dd3f21828d4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=509c3939-1868-4c77-82f8-ea7b44b9f7a3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:33:05Z,use_quota=True,user_id='35eb9b3d674b4ad9895a5c770623ba33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ada97c9-dc23-43c8-84ec-21f010ace33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ada97c9-dc23-43c8-84ec-21f010ace33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375f95db-c60d-41a7-a03b-73a31210bbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375f95db-c60d-41a7-a03b-73a31210bbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3b7f8a4c-b992-4c53-953e-4da3326b68e4', 'volume_name': 'volume-3b7f8a4c-b992-4c53-953e-4da3326b68e4', 'volume_size': 1, 'snapshot_id': '509c3939-1868-4c77-82f8-ea7b44b9f7a3'}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ae1728-b8e9-4559-ab9c-829b7d10ca0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ae1728-b8e9-4559-ab9c-829b7d10ca0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eabd192-1a4c-456f-8ee9-eec3780ed656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:33:05 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Volume 3b7f8a4c-b992-4c53-953e-4da3326b68e4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3b7f8a4c-b992-4c53-953e-4da3326b68e4', 'volume_size': 1, 'snapshot_id': '509c3939-1868-4c77-82f8-ea7b44b9f7a3'} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Acquiring lock "cinder-quobyte-509c3939-1868-4c77-82f8-ea7b44b9f7a3-3b7f8a4c-b992-4c53-953e-4da3326b68e4" by "_create_volume_from_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Lock "cinder-quobyte-509c3939-1868-4c77-82f8-ea7b44b9f7a3-3b7f8a4c-b992-4c53-953e-4da3326b68e4" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Creating volume 3b7f8a4c-b992-4c53-953e-4da3326b68e4 from snapshot 509c3939-1868-4c77-82f8-ea7b44b9f7a3 {{(pid=93781) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Acquiring lock "cinder-quobyte-3b7f8a4c-b992-4c53-953e-4da3326b68e4" by "_copy_volume_from_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Lock "cinder-quobyte-3b7f8a4c-b992-4c53-953e-4da3326b68e4" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] snapshot: 509c3939-1868-4c77-82f8-ea7b44b9f7a3, volume: 3b7f8a4c-b992-4c53-953e-4da3326b68e4, {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[52074a17-18fc-4e20-bbf7-bb6e6a5aad94]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.509c3939-1868-4c77-82f8-ea7b44b9f7a3 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:05 devstack sudo[114995]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-47eda914-cc64-4e96-8ac3-af29e07bf72a tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c94a62c7-e3fc-4a58-b81b-e02291216bbc" returned: 0 in 1.243s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:05 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-47eda914-cc64-4e96-8ac3-af29e07bf72a tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c94a62c7-e3fc-4a58-b81b-e02291216bbc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:05 devstack sudo[115002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c94a62c7-e3fc-4a58-b81b-e02291216bbc Jun 30 16:33:05 devstack sudo[115002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:05 devstack sudo[115001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.509c3939-1868-4c77-82f8-ea7b44b9f7a3 Jun 30 16:33:05 devstack sudo[115001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:06 devstack sudo[115002]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-47eda914-cc64-4e96-8ac3-af29e07bf72a tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-c94a62c7-e3fc-4a58-b81b-e02291216bbc" returned: 0 in 0.981s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:06 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-47eda914-cc64-4e96-8ac3-af29e07bf72a tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-quobyte-c94a62c7-e3fc-4a58-b81b-e02291216bbc" released by "delete_volume" :: held 2.303s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:06 devstack sudo[115001]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.509c3939-1868-4c77-82f8-ea7b44b9f7a3" returned: 0 in 1.066s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:33:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] will copy from snapshot at /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 30 16:33:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Creating direct copy from snapshot {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 30 16:33:06 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ad8828-882c-47d5-a7c4-a8a3feaf5737]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:33:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:06 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-47eda914-cc64-4e96-8ac3-af29e07bf72a tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Created reservations ['08bbb03d-37c9-406b-aa24-198af32c4f2a', 'e1e713bf-1c5f-4d50-9f32-e8a6f2eeed29', 'c625030d-7ddf-4629-98a9-4da6d0184f38', 'cd069e37-e03e-400f-a94b-c2beb67c1cc7'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:33:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-47eda914-cc64-4e96-8ac3-af29e07bf72a tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:33:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-47eda914-cc64-4e96-8ac3-af29e07bf72a tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:33:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-47eda914-cc64-4e96-8ac3-af29e07bf72a tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:33:06 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-47eda914-cc64-4e96-8ac3-af29e07bf72a tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:33:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-47eda914-cc64-4e96-8ac3-af29e07bf72a tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:33:06 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-47eda914-cc64-4e96-8ac3-af29e07bf72a tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:06 devstack sudo[115009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb Jun 30 16:33:06 devstack sudo[115009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:06 devstack sudo[115010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:33:06 devstack sudo[115010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:07 devstack sudo[115010]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-47eda914-cc64-4e96-8ac3-af29e07bf72a tempest-CreateVolumesFromSourceVolumeTest-895903242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.848s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:07 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-47eda914-cc64-4e96-8ac3-af29e07bf72a tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:33:07 devstack sudo[115009]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:07 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-47eda914-cc64-4e96-8ac3-af29e07bf72a tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Deleted volume successfully. Jun 30 16:33:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb" returned: 0 in 1.036s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:07 devstack cinder-volume[93781]: DEBUG cinder.utils [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Path /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3b7f8a4c-b992-4c53-953e-4da3326b68e4 not found in is_blk_device check {{(pid=93781) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 30 16:33:07 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3b7f8a4c-b992-4c53-953e-4da3326b68e4 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:07 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-47eda914-cc64-4e96-8ac3-af29e07bf72a tempest-CreateVolumesFromSourceVolumeTest-895903242 None] Lock "cinder-c94a62c7-e3fc-4a58-b81b-e02291216bbc-delete_volume" released by "delete_volume" :: held 3.489s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:07 devstack sudo[115020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3b7f8a4c-b992-4c53-953e-4da3326b68e4 Jun 30 16:33:07 devstack sudo[115020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:14 devstack sudo[115020]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3b7f8a4c-b992-4c53-953e-4da3326b68e4" returned: 0 in 6.356s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:14 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f0276d-8e7d-4db8-81a1-5e78419dd2aa]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:33:14 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:14 devstack sudo[115069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb Jun 30 16:33:14 devstack sudo[115069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:15 devstack sudo[115069]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb" returned: 0 in 1.203s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:15 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Image conversion details: src /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3b7f8a4c-b992-4c53-953e-4da3326b68e4 {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:33:15 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Converted 1024.00 MB image at 161.05 MB/s Jun 30 16:33:15 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3b7f8a4c-b992-4c53-953e-4da3326b68e4 is being set with open permissions: ugo+rw Jun 30 16:33:15 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3b7f8a4c-b992-4c53-953e-4da3326b68e4 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:15 devstack sudo[115075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3b7f8a4c-b992-4c53-953e-4da3326b68e4 Jun 30 16:33:15 devstack sudo[115075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:16 devstack sudo[115075]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3b7f8a4c-b992-4c53-953e-4da3326b68e4" returned: 0 in 0.779s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:16 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Lock "cinder-quobyte-3b7f8a4c-b992-4c53-953e-4da3326b68e4" released by "_copy_volume_from_snapshot" :: held 10.597s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:16 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Lock "cinder-quobyte-509c3939-1868-4c77-82f8-ea7b44b9f7a3-3b7f8a4c-b992-4c53-953e-4da3326b68e4" released by "_create_volume_from_snapshot" :: held 10.662s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.709s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:33:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eabd192-1a4c-456f-8ee9-eec3780ed656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b7f8a4c-b992-4c53-953e-4da3326b68e4', 'volume_size': 1, 'snapshot_id': '509c3939-1868-4c77-82f8-ea7b44b9f7a3'}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:33:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6313ad5-ebfe-46eb-86eb-9f0a99bf3838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:33:16 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Volume volume-3b7f8a4c-b992-4c53-953e-4da3326b68e4 (3b7f8a4c-b992-4c53-953e-4da3326b68e4): created successfully Jun 30 16:33:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6313ad5-ebfe-46eb-86eb-9f0a99bf3838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:33:16 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Flow 'volume_create_manager' (dfb43ec7-4a5b-43c5-ae78-3c9b3b114dd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:33:16 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-76bcfecb-c04b-480f-ac22-0cb0c31ed2c5 tempest-VolumeDependencyTests-1618039585 None] Created volume successfully. Jun 30 16:33:16 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1d76f412-bc7d-4e53-8b03-7a520ee35275 tempest-VolumeDependencyTests-1618039585 None] Acquiring lock "cinder-509c3939-1868-4c77-82f8-ea7b44b9f7a3-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:33:16 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1d76f412-bc7d-4e53-8b03-7a520ee35275 tempest-VolumeDependencyTests-1618039585 None] Lock "cinder-509c3939-1868-4c77-82f8-ea7b44b9f7a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:33:16 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1d76f412-bc7d-4e53-8b03-7a520ee35275 tempest-VolumeDependencyTests-1618039585 None] Acquiring lock "cinder-quobyte-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:33:16 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1d76f412-bc7d-4e53-8b03-7a520ee35275 tempest-VolumeDependencyTests-1618039585 None] Lock "cinder-quobyte-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:33:16 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1d76f412-bc7d-4e53-8b03-7a520ee35275 tempest-VolumeDependencyTests-1618039585 None] Acquiring lock "cinder-quobyte-509c3939-1868-4c77-82f8-ea7b44b9f7a3" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:33:16 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1d76f412-bc7d-4e53-8b03-7a520ee35275 tempest-VolumeDependencyTests-1618039585 None] Lock "cinder-quobyte-509c3939-1868-4c77-82f8-ea7b44b9f7a3" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:33:16 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-1d76f412-bc7d-4e53-8b03-7a520ee35275 tempest-VolumeDependencyTests-1618039585 None] Deleting offline snapshot 509c3939-1868-4c77-82f8-ea7b44b9f7a3 of volume b6fb45af-dec2-4b17-8486-7fc0c5f8dacb {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:33:16 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-1d76f412-bc7d-4e53-8b03-7a520ee35275 tempest-VolumeDependencyTests-1618039585 None] snapshot_file for this snap is: volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.509c3939-1868-4c77-82f8-ea7b44b9f7a3 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:33:16 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2dec92-5b5c-40aa-9824-3da0cf883b03]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:33:16 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1d76f412-bc7d-4e53-8b03-7a520ee35275 tempest-VolumeDependencyTests-1618039585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.509c3939-1868-4c77-82f8-ea7b44b9f7a3 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:16 devstack sudo[115078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.509c3939-1868-4c77-82f8-ea7b44b9f7a3 Jun 30 16:33:16 devstack sudo[115078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:17 devstack sudo[115078]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1d76f412-bc7d-4e53-8b03-7a520ee35275 tempest-VolumeDependencyTests-1618039585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.509c3939-1868-4c77-82f8-ea7b44b9f7a3" returned: 0 in 1.098s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:17 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-1d76f412-bc7d-4e53-8b03-7a520ee35275 tempest-VolumeDependencyTests-1618039585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:33:17 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74ea922-959a-4ff4-9fae-1ab16944e11b]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:33:17 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1d76f412-bc7d-4e53-8b03-7a520ee35275 tempest-VolumeDependencyTests-1618039585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:17 devstack sudo[115085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb Jun 30 16:33:17 devstack sudo[115085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:18 devstack sudo[115085]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1d76f412-bc7d-4e53-8b03-7a520ee35275 tempest-VolumeDependencyTests-1618039585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb" returned: 0 in 0.997s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:18 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1d76f412-bc7d-4e53-8b03-7a520ee35275 tempest-VolumeDependencyTests-1618039585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.509c3939-1868-4c77-82f8-ea7b44b9f7a3 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:18 devstack sudo[115090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.509c3939-1868-4c77-82f8-ea7b44b9f7a3 Jun 30 16:33:18 devstack sudo[115090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:19 devstack sudo[115090]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1d76f412-bc7d-4e53-8b03-7a520ee35275 tempest-VolumeDependencyTests-1618039585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.509c3939-1868-4c77-82f8-ea7b44b9f7a3" returned: 0 in 0.850s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:19 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1d76f412-bc7d-4e53-8b03-7a520ee35275 tempest-VolumeDependencyTests-1618039585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.509c3939-1868-4c77-82f8-ea7b44b9f7a3 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:19 devstack sudo[115096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.509c3939-1868-4c77-82f8-ea7b44b9f7a3 Jun 30 16:33:19 devstack sudo[115096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:20 devstack sudo[115096]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1d76f412-bc7d-4e53-8b03-7a520ee35275 tempest-VolumeDependencyTests-1618039585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb.509c3939-1868-4c77-82f8-ea7b44b9f7a3" returned: 0 in 0.844s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1d76f412-bc7d-4e53-8b03-7a520ee35275 tempest-VolumeDependencyTests-1618039585 None] Lock "cinder-quobyte-509c3939-1868-4c77-82f8-ea7b44b9f7a3" released by "_delete_snapshot" :: held 3.938s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1d76f412-bc7d-4e53-8b03-7a520ee35275 tempest-VolumeDependencyTests-1618039585 None] Lock "cinder-quobyte-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb" released by "delete_snapshot" :: held 3.972s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:20 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-1d76f412-bc7d-4e53-8b03-7a520ee35275 tempest-VolumeDependencyTests-1618039585 None] Created reservations ['5af137fc-2cf8-4023-853f-dda0c20346e2', '5f9e3def-34bb-4ea5-968c-2bd7675c248c', '100e2422-91ad-4d26-a831-bb5fda7a3008', '99f5a0dd-c19e-4f84-965f-3194cba813b8'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:33:20 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-1d76f412-bc7d-4e53-8b03-7a520ee35275 tempest-VolumeDependencyTests-1618039585 None] Delete snapshot completed successfully. Jun 30 16:33:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1d76f412-bc7d-4e53-8b03-7a520ee35275 tempest-VolumeDependencyTests-1618039585 None] Lock "cinder-509c3939-1868-4c77-82f8-ea7b44b9f7a3-delete_snapshot" released by "delete_snapshot" :: held 4.161s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1d0a5ba0-a795-4a26-9cc2-f9f3d7149af9 tempest-VolumeDependencyTests-1618039585 None] Acquiring lock "cinder-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:33:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1d0a5ba0-a795-4a26-9cc2-f9f3d7149af9 tempest-VolumeDependencyTests-1618039585 None] Lock "cinder-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:33:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1d0a5ba0-a795-4a26-9cc2-f9f3d7149af9 tempest-VolumeDependencyTests-1618039585 None] Acquiring lock "cinder-quobyte-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:33:20 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1d0a5ba0-a795-4a26-9cc2-f9f3d7149af9 tempest-VolumeDependencyTests-1618039585 None] Lock "cinder-quobyte-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb" acquired by "delete_volume" :: waited 0.024s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:33:20 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[60efba7b-0f40-4cd4-a095-2883e0258f13]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:33:20 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1d0a5ba0-a795-4a26-9cc2-f9f3d7149af9 tempest-VolumeDependencyTests-1618039585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:21 devstack sudo[115100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb Jun 30 16:33:21 devstack sudo[115100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Flow 'volume_create_manager' (0752b8f2-5c78-4bbd-837a-a5b358d9830b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154e6f10-9a70-4685-9aff-3d570654cc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154e6f10-9a70-4685-9aff-3d570654cc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2107036264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f16c4923-1db2-4aab-b44e-68cc83d65f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aaa729f9eda4778bd962367d72961d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:33:21Z,use_quota=True,user_id='08db31afdc1d43819bb0e590f2a3d600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c833fae-b278-4da9-9af2-88f4b8226108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c833fae-b278-4da9-9af2-88f4b8226108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0fdee10-2639-4481-906c-6f5fa23be2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0fdee10-2639-4481-906c-6f5fa23be2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f16c4923-1db2-4aab-b44e-68cc83d65f54', 'volume_name': 'volume-f16c4923-1db2-4aab-b44e-68cc83d65f54', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5719934-e3e8-4f9e-853f-fc3993488710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5719934-e3e8-4f9e-853f-fc3993488710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d6db35-6c23-4f79-a998-79ef27d18779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:33:21 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Volume f16c4923-1db2-4aab-b44e-68cc83d65f54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f16c4923-1db2-4aab-b44e-68cc83d65f54', 'volume_size': 1} Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2107036264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f16c4923-1db2-4aab-b44e-68cc83d65f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aaa729f9eda4778bd962367d72961d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:33:21Z,use_quota=True,user_id='08db31afdc1d43819bb0e590f2a3d600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)}" {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Creating volume f16c4923-1db2-4aab-b44e-68cc83d65f54 {{(pid=93781) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:33:21 devstack cinder-volume[93781]: INFO cinder.volume.drivers.remotefs [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] casted to osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 1073741824 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:21 devstack sudo[115102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 1073741824 Jun 30 16:33:21 devstack sudo[115102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:21 devstack sudo[115100]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1d0a5ba0-a795-4a26-9cc2-f9f3d7149af9 tempest-VolumeDependencyTests-1618039585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb" returned: 0 in 0.795s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:21 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1d0a5ba0-a795-4a26-9cc2-f9f3d7149af9 tempest-VolumeDependencyTests-1618039585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:21 devstack sudo[115107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb Jun 30 16:33:21 devstack sudo[115107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:22 devstack sudo[115102]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 1073741824" returned: 0 in 0.917s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:22 devstack sudo[115114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 Jun 30 16:33:22 devstack sudo[115114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:22 devstack sudo[115107]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1d0a5ba0-a795-4a26-9cc2-f9f3d7149af9 tempest-VolumeDependencyTests-1618039585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb" returned: 0 in 0.740s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:22 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1d0a5ba0-a795-4a26-9cc2-f9f3d7149af9 tempest-VolumeDependencyTests-1618039585 None] Lock "cinder-quobyte-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb" released by "delete_volume" :: held 1.612s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:22 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-1d0a5ba0-a795-4a26-9cc2-f9f3d7149af9 tempest-VolumeDependencyTests-1618039585 None] Created reservations ['7491c1a2-e27e-43f7-b955-33f944407414', 'f6af5957-8574-4893-9cac-a166dbb59eb5', '9813002c-e56d-4657-975e-4c5347775ac3', '4ef5921e-280a-4f9d-a976-17df6b0869a1'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:33:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1d0a5ba0-a795-4a26-9cc2-f9f3d7149af9 tempest-VolumeDependencyTests-1618039585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:33:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1d0a5ba0-a795-4a26-9cc2-f9f3d7149af9 tempest-VolumeDependencyTests-1618039585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:33:22 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1d0a5ba0-a795-4a26-9cc2-f9f3d7149af9 tempest-VolumeDependencyTests-1618039585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:33:22 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-1d0a5ba0-a795-4a26-9cc2-f9f3d7149af9 tempest-VolumeDependencyTests-1618039585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:33:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-1d0a5ba0-a795-4a26-9cc2-f9f3d7149af9 tempest-VolumeDependencyTests-1618039585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:33:22 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1d0a5ba0-a795-4a26-9cc2-f9f3d7149af9 tempest-VolumeDependencyTests-1618039585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:22 devstack sudo[115116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:33:22 devstack sudo[115116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:23 devstack sudo[115114]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54" returned: 0 in 0.693s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'} {{(pid=93781) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 30 16:33:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:33:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ab84921d-30ae-4dc9-add6-16707cd4f445 tempest-VolumeDependencyTests-1618039585 None] Acquiring lock "cinder-3b7f8a4c-b992-4c53-953e-4da3326b68e4-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:33:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ab84921d-30ae-4dc9-add6-16707cd4f445 tempest-VolumeDependencyTests-1618039585 None] Lock "cinder-3b7f8a4c-b992-4c53-953e-4da3326b68e4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:33:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d6db35-6c23-4f79-a998-79ef27d18779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f16c4923-1db2-4aab-b44e-68cc83d65f54', 'volume_size': 1}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:33:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fee134b-5d44-43d2-abe3-d037a8ad6d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:33:23 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Volume volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 (f16c4923-1db2-4aab-b44e-68cc83d65f54): created successfully Jun 30 16:33:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fee134b-5d44-43d2-abe3-d037a8ad6d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:33:23 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Flow 'volume_create_manager' (0752b8f2-5c78-4bbd-837a-a5b358d9830b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:33:23 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-87198d9d-5dd0-46ab-af33-bedf33aae8cc tempest-SnapshotDependencyTests-1407213729 None] Created volume successfully. Jun 30 16:33:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ab84921d-30ae-4dc9-add6-16707cd4f445 tempest-VolumeDependencyTests-1618039585 None] Acquiring lock "cinder-quobyte-3b7f8a4c-b992-4c53-953e-4da3326b68e4" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:33:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ab84921d-30ae-4dc9-add6-16707cd4f445 tempest-VolumeDependencyTests-1618039585 None] Lock "cinder-quobyte-3b7f8a4c-b992-4c53-953e-4da3326b68e4" acquired by "delete_volume" :: waited 0.025s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:33:23 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[c619a60b-14d9-47e6-862b-293d2325c604]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:33:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ab84921d-30ae-4dc9-add6-16707cd4f445 tempest-VolumeDependencyTests-1618039585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3b7f8a4c-b992-4c53-953e-4da3326b68e4 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:23 devstack sudo[115116]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:23 devstack sudo[115120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3b7f8a4c-b992-4c53-953e-4da3326b68e4 Jun 30 16:33:23 devstack sudo[115120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-1d0a5ba0-a795-4a26-9cc2-f9f3d7149af9 tempest-VolumeDependencyTests-1618039585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.779s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:23 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-1d0a5ba0-a795-4a26-9cc2-f9f3d7149af9 tempest-VolumeDependencyTests-1618039585 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:33:23 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-1d0a5ba0-a795-4a26-9cc2-f9f3d7149af9 tempest-VolumeDependencyTests-1618039585 None] Deleted volume successfully. Jun 30 16:33:23 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-1d0a5ba0-a795-4a26-9cc2-f9f3d7149af9 tempest-VolumeDependencyTests-1618039585 None] Lock "cinder-b6fb45af-dec2-4b17-8486-7fc0c5f8dacb-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-312c80b5-e10e-45b2-b87b-cce86f4f9b89 tempest-SnapshotDependencyTests-1407213729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:33:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-312c80b5-e10e-45b2-b87b-cce86f4f9b89 tempest-SnapshotDependencyTests-1407213729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:33:23 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-312c80b5-e10e-45b2-b87b-cce86f4f9b89 tempest-SnapshotDependencyTests-1407213729 None] Creating offline snapshot 01fc6edd-2a77-4aa2-a58b-07a316df13e7 of volume f16c4923-1db2-4aab-b44e-68cc83d65f54 {{(pid=93781) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 30 16:33:23 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df64008-00e3-469b-8f57-6e81ec81b923]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:33:23 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-312c80b5-e10e-45b2-b87b-cce86f4f9b89 tempest-SnapshotDependencyTests-1407213729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:23 devstack sudo[115122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 Jun 30 16:33:23 devstack sudo[115122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:24 devstack sudo[115120]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ab84921d-30ae-4dc9-add6-16707cd4f445 tempest-VolumeDependencyTests-1618039585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3b7f8a4c-b992-4c53-953e-4da3326b68e4" returned: 0 in 0.908s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ab84921d-30ae-4dc9-add6-16707cd4f445 tempest-VolumeDependencyTests-1618039585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3b7f8a4c-b992-4c53-953e-4da3326b68e4 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:24 devstack sudo[115127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3b7f8a4c-b992-4c53-953e-4da3326b68e4 Jun 30 16:33:24 devstack sudo[115127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:24 devstack sudo[115122]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-312c80b5-e10e-45b2-b87b-cce86f4f9b89 tempest-SnapshotDependencyTests-1407213729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54" returned: 0 in 0.877s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-312c80b5-e10e-45b2-b87b-cce86f4f9b89 tempest-SnapshotDependencyTests-1407213729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.01fc6edd-2a77-4aa2-a58b-07a316df13e7 1G {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:24 devstack sudo[115132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.01fc6edd-2a77-4aa2-a58b-07a316df13e7 1G Jun 30 16:33:24 devstack sudo[115132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:24 devstack sudo[115127]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:24 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ab84921d-30ae-4dc9-add6-16707cd4f445 tempest-VolumeDependencyTests-1618039585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-3b7f8a4c-b992-4c53-953e-4da3326b68e4" returned: 0 in 0.752s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:25 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ab84921d-30ae-4dc9-add6-16707cd4f445 tempest-VolumeDependencyTests-1618039585 None] Lock "cinder-quobyte-3b7f8a4c-b992-4c53-953e-4da3326b68e4" released by "delete_volume" :: held 1.714s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:25 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-ab84921d-30ae-4dc9-add6-16707cd4f445 tempest-VolumeDependencyTests-1618039585 None] Created reservations ['d3fbc1a7-6256-4c1b-beca-9cc967524408', '92a48751-af18-4a1d-9894-eb53e6e0d831', 'd8fb0bd7-97c9-42b6-93a8-992f749f9d81', 'a2bc12d7-ca68-46b1-91df-236a5f1bf6c6'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:33:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ab84921d-30ae-4dc9-add6-16707cd4f445 tempest-VolumeDependencyTests-1618039585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:33:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ab84921d-30ae-4dc9-add6-16707cd4f445 tempest-VolumeDependencyTests-1618039585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:33:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ab84921d-30ae-4dc9-add6-16707cd4f445 tempest-VolumeDependencyTests-1618039585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:33:25 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-ab84921d-30ae-4dc9-add6-16707cd4f445 tempest-VolumeDependencyTests-1618039585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:33:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-ab84921d-30ae-4dc9-add6-16707cd4f445 tempest-VolumeDependencyTests-1618039585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:33:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ab84921d-30ae-4dc9-add6-16707cd4f445 tempest-VolumeDependencyTests-1618039585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:25 devstack sudo[115135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:33:25 devstack sudo[115135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:25 devstack sudo[115132]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-312c80b5-e10e-45b2-b87b-cce86f4f9b89 tempest-SnapshotDependencyTests-1407213729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.01fc6edd-2a77-4aa2-a58b-07a316df13e7 1G" returned: 0 in 1.047s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-312c80b5-e10e-45b2-b87b-cce86f4f9b89 tempest-SnapshotDependencyTests-1407213729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.01fc6edd-2a77-4aa2-a58b-07a316df13e7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:25 devstack sudo[115141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.01fc6edd-2a77-4aa2-a58b-07a316df13e7 Jun 30 16:33:25 devstack sudo[115141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:25 devstack sudo[115135]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:25 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-ab84921d-30ae-4dc9-add6-16707cd4f445 tempest-VolumeDependencyTests-1618039585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.792s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:25 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-ab84921d-30ae-4dc9-add6-16707cd4f445 tempest-VolumeDependencyTests-1618039585 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:33:25 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-ab84921d-30ae-4dc9-add6-16707cd4f445 tempest-VolumeDependencyTests-1618039585 None] Deleted volume successfully. Jun 30 16:33:26 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-ab84921d-30ae-4dc9-add6-16707cd4f445 tempest-VolumeDependencyTests-1618039585 None] Lock "cinder-3b7f8a4c-b992-4c53-953e-4da3326b68e4-delete_volume" released by "delete_volume" :: held 2.813s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:26 devstack sudo[115141]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-312c80b5-e10e-45b2-b87b-cce86f4f9b89 tempest-SnapshotDependencyTests-1407213729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 -F qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.01fc6edd-2a77-4aa2-a58b-07a316df13e7" returned: 0 in 0.913s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:26 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-312c80b5-e10e-45b2-b87b-cce86f4f9b89 tempest-SnapshotDependencyTests-1407213729 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.01fc6edd-2a77-4aa2-a58b-07a316df13e7 is being set with open permissions: ugo+rw Jun 30 16:33:26 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-312c80b5-e10e-45b2-b87b-cce86f4f9b89 tempest-SnapshotDependencyTests-1407213729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.01fc6edd-2a77-4aa2-a58b-07a316df13e7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:26 devstack sudo[115147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.01fc6edd-2a77-4aa2-a58b-07a316df13e7 Jun 30 16:33:26 devstack sudo[115147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:27 devstack sudo[115147]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-312c80b5-e10e-45b2-b87b-cce86f4f9b89 tempest-SnapshotDependencyTests-1407213729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.01fc6edd-2a77-4aa2-a58b-07a316df13e7" returned: 0 in 0.701s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:27 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-312c80b5-e10e-45b2-b87b-cce86f4f9b89 tempest-SnapshotDependencyTests-1407213729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:27 devstack sudo[115151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.info Jun 30 16:33:27 devstack sudo[115151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:28 devstack sudo[115151]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-312c80b5-e10e-45b2-b87b-cce86f4f9b89 tempest-SnapshotDependencyTests-1407213729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.info" returned: 0 in 0.665s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:28 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-312c80b5-e10e-45b2-b87b-cce86f4f9b89 tempest-SnapshotDependencyTests-1407213729 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.info is being set with open permissions: ugo+rw Jun 30 16:33:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-312c80b5-e10e-45b2-b87b-cce86f4f9b89 tempest-SnapshotDependencyTests-1407213729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.info {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:28 devstack sudo[115154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.info Jun 30 16:33:28 devstack sudo[115154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:28 devstack sudo[115154]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-312c80b5-e10e-45b2-b87b-cce86f4f9b89 tempest-SnapshotDependencyTests-1407213729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.info" returned: 0 in 0.724s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:28 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-312c80b5-e10e-45b2-b87b-cce86f4f9b89 tempest-SnapshotDependencyTests-1407213729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.028s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:33:28 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-312c80b5-e10e-45b2-b87b-cce86f4f9b89 tempest-SnapshotDependencyTests-1407213729 None] Create snapshot completed successfully Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG cinder.volume.flows.manager.create_volume [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93781) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Flow 'volume_create_manager' (71500fc1-db7e-448a-91ce-5f008a96ab42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bac2416-ce45-4a5c-a385-ca83fd7f604d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bac2416-ce45-4a5c-a385-ca83fd7f604d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-30T14:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488befa4-fb66-464a-bb09-584ff9c36bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aaa729f9eda4778bd962367d72961d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-30T14:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=01fc6edd-2a77-4aa2-a58b-07a316df13e7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-30T14:33:30Z,use_quota=True,user_id='08db31afdc1d43819bb0e590f2a3d600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0d247a0-f3a9-4d58-b9bc-c67492e6e80e),volume_type_id=d0d247a0-f3a9-4d58-b9bc-c67492e6e80e)' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6432342-ced8-4c65-a04d-9ca24eb16711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6432342-ced8-4c65-a04d-9ca24eb16711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9627394b-9f0a-47bc-baa4-ca4174c36d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9627394b-9f0a-47bc-baa4-ca4174c36d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '488befa4-fb66-464a-bb09-584ff9c36bcc', 'volume_name': 'volume-488befa4-fb66-464a-bb09-584ff9c36bcc', 'volume_size': 1, 'snapshot_id': '01fc6edd-2a77-4aa2-a58b-07a316df13e7'}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd6360fd-b626-4f08-b0a0-5ab9e7cd3e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd6360fd-b626-4f08-b0a0-5ab9e7cd3e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c69580bc-1c44-44b7-96da-b13948dbd06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:33:29 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Volume 488befa4-fb66-464a-bb09-584ff9c36bcc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-488befa4-fb66-464a-bb09-584ff9c36bcc', 'volume_size': 1, 'snapshot_id': '01fc6edd-2a77-4aa2-a58b-07a316df13e7'} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Acquiring lock "cinder-quobyte-01fc6edd-2a77-4aa2-a58b-07a316df13e7-488befa4-fb66-464a-bb09-584ff9c36bcc" by "_create_volume_from_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Lock "cinder-quobyte-01fc6edd-2a77-4aa2-a58b-07a316df13e7-488befa4-fb66-464a-bb09-584ff9c36bcc" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Creating volume 488befa4-fb66-464a-bb09-584ff9c36bcc from snapshot 01fc6edd-2a77-4aa2-a58b-07a316df13e7 {{(pid=93781) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Selected osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a as target Quobyte volume. {{(pid=93781) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Acquiring lock "cinder-quobyte-488befa4-fb66-464a-bb09-584ff9c36bcc" by "_copy_volume_from_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Lock "cinder-quobyte-488befa4-fb66-464a-bb09-584ff9c36bcc" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] snapshot: 01fc6edd-2a77-4aa2-a58b-07a316df13e7, volume: 488befa4-fb66-464a-bb09-584ff9c36bcc, {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee6c61d-7103-4789-916d-698188ef3723]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:33:29 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.01fc6edd-2a77-4aa2-a58b-07a316df13e7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:30 devstack sudo[115157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.01fc6edd-2a77-4aa2-a58b-07a316df13e7 Jun 30 16:33:30 devstack sudo[115157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:30 devstack sudo[115157]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.01fc6edd-2a77-4aa2-a58b-07a316df13e7" returned: 0 in 0.880s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f16c4923-1db2-4aab-b44e-68cc83d65f54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:33:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] will copy from snapshot at /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 30 16:33:30 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Creating direct copy from snapshot {{(pid=93781) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 30 16:33:30 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b6fd38-c7d9-4687-8cfc-e7b03a03dfb3]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:33:30 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:30 devstack sudo[115162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 Jun 30 16:33:30 devstack sudo[115162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:31 devstack sudo[115162]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54" returned: 0 in 0.963s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:31 devstack cinder-volume[93781]: DEBUG cinder.utils [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Path /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-488befa4-fb66-464a-bb09-584ff9c36bcc not found in is_blk_device check {{(pid=93781) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 30 16:33:31 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-488befa4-fb66-464a-bb09-584ff9c36bcc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:31 devstack sudo[115167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-488befa4-fb66-464a-bb09-584ff9c36bcc Jun 30 16:33:31 devstack sudo[115167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:33 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:33:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:33:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:33:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:33:33 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:33:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:33:33 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:33 devstack sudo[115179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:33:33 devstack sudo[115179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:34 devstack sudo[115179]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:34 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 1.353s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:34 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:33:34 devstack cinder-volume[93781]: DEBUG oslo_service.periodic_task [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] Running periodic task VolumeManager._thread_info {{(pid=93781) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 30 16:33:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread count: 28 {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 30 16:33:34 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-a929d9b4-eed5-4086-9f75-27150b93e936 None None] thread info: [<_MainThread(MainThread, started 140014056992896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93781) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 30 16:33:37 devstack sudo[115167]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-488befa4-fb66-464a-bb09-584ff9c36bcc" returned: 0 in 5.251s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:37 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[4515f9d0-79b8-474d-8132-b74674f10dc9]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:33:37 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:37 devstack sudo[115183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 Jun 30 16:33:37 devstack sudo[115183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:38 devstack sudo[115183]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54" returned: 0 in 1.020s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:38 devstack cinder-volume[93781]: DEBUG cinder.image.image_utils [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Image conversion details: src /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54, size 1024.00 MB, duration 5.25 sec, destination /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-488befa4-fb66-464a-bb09-584ff9c36bcc {{(pid=93781) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 30 16:33:38 devstack cinder-volume[93781]: INFO cinder.image.image_utils [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Converted 1024.00 MB image at 194.97 MB/s Jun 30 16:33:38 devstack cinder-volume[93781]: WARNING cinder.volume.drivers.remotefs [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-488befa4-fb66-464a-bb09-584ff9c36bcc is being set with open permissions: ugo+rw Jun 30 16:33:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-488befa4-fb66-464a-bb09-584ff9c36bcc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:38 devstack sudo[115189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-488befa4-fb66-464a-bb09-584ff9c36bcc Jun 30 16:33:38 devstack sudo[115189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:38 devstack sudo[115189]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-488befa4-fb66-464a-bb09-584ff9c36bcc" returned: 0 in 0.720s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Lock "cinder-quobyte-488befa4-fb66-464a-bb09-584ff9c36bcc" released by "_copy_volume_from_snapshot" :: held 8.944s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:38 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Lock "cinder-quobyte-01fc6edd-2a77-4aa2-a58b-07a316df13e7-488befa4-fb66-464a-bb09-584ff9c36bcc" released by "_create_volume_from_snapshot" :: held 8.977s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:38 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.993s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:33:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c69580bc-1c44-44b7-96da-b13948dbd06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-488befa4-fb66-464a-bb09-584ff9c36bcc', 'volume_size': 1, 'snapshot_id': '01fc6edd-2a77-4aa2-a58b-07a316df13e7'}' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:33:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5adb2d4f-a87a-4e2e-9e8b-1cfc637489e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 30 16:33:38 devstack cinder-volume[93781]: INFO cinder.volume.flows.manager.create_volume [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Volume volume-488befa4-fb66-464a-bb09-584ff9c36bcc (488befa4-fb66-464a-bb09-584ff9c36bcc): created successfully Jun 30 16:33:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5adb2d4f-a87a-4e2e-9e8b-1cfc637489e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93781) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 30 16:33:38 devstack cinder-volume[93781]: DEBUG cinder.volume.manager [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Flow 'volume_create_manager' (71500fc1-db7e-448a-91ce-5f008a96ab42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93781) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 30 16:33:38 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-505cc6c8-5d54-40a6-a5cc-5fd90ab3d48e tempest-SnapshotDependencyTests-1407213729 None] Created volume successfully. Jun 30 16:33:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-81fb8e73-2978-4133-bba9-7cc8bfaadeb2 tempest-SnapshotDependencyTests-1407213729 None] Acquiring lock "cinder-01fc6edd-2a77-4aa2-a58b-07a316df13e7-delete_snapshot" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:33:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-81fb8e73-2978-4133-bba9-7cc8bfaadeb2 tempest-SnapshotDependencyTests-1407213729 None] Lock "cinder-01fc6edd-2a77-4aa2-a58b-07a316df13e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:33:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-81fb8e73-2978-4133-bba9-7cc8bfaadeb2 tempest-SnapshotDependencyTests-1407213729 None] Acquiring lock "cinder-quobyte-f16c4923-1db2-4aab-b44e-68cc83d65f54" by "delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:33:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-81fb8e73-2978-4133-bba9-7cc8bfaadeb2 tempest-SnapshotDependencyTests-1407213729 None] Lock "cinder-quobyte-f16c4923-1db2-4aab-b44e-68cc83d65f54" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:33:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-81fb8e73-2978-4133-bba9-7cc8bfaadeb2 tempest-SnapshotDependencyTests-1407213729 None] Acquiring lock "cinder-quobyte-01fc6edd-2a77-4aa2-a58b-07a316df13e7" by "_delete_snapshot" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:33:39 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-81fb8e73-2978-4133-bba9-7cc8bfaadeb2 tempest-SnapshotDependencyTests-1407213729 None] Lock "cinder-quobyte-01fc6edd-2a77-4aa2-a58b-07a316df13e7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:33:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-81fb8e73-2978-4133-bba9-7cc8bfaadeb2 tempest-SnapshotDependencyTests-1407213729 None] Deleting offline snapshot 01fc6edd-2a77-4aa2-a58b-07a316df13e7 of volume f16c4923-1db2-4aab-b44e-68cc83d65f54 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 30 16:33:39 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-81fb8e73-2978-4133-bba9-7cc8bfaadeb2 tempest-SnapshotDependencyTests-1407213729 None] snapshot_file for this snap is: volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.01fc6edd-2a77-4aa2-a58b-07a316df13e7 {{(pid=93781) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 30 16:33:39 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa0cf96-4d05-4a79-8e7f-84161c73297f]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:33:39 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-81fb8e73-2978-4133-bba9-7cc8bfaadeb2 tempest-SnapshotDependencyTests-1407213729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.01fc6edd-2a77-4aa2-a58b-07a316df13e7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:40 devstack sudo[115192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.01fc6edd-2a77-4aa2-a58b-07a316df13e7 Jun 30 16:33:40 devstack sudo[115192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:40 devstack sudo[115192]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-81fb8e73-2978-4133-bba9-7cc8bfaadeb2 tempest-SnapshotDependencyTests-1407213729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.01fc6edd-2a77-4aa2-a58b-07a316df13e7" returned: 0 in 0.997s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:40 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.remotefs [None req-81fb8e73-2978-4133-bba9-7cc8bfaadeb2 tempest-SnapshotDependencyTests-1407213729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f16c4923-1db2-4aab-b44e-68cc83d65f54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93781) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 30 16:33:40 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab878bb-a990-482e-bdec-658290e9dc39]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:33:40 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-81fb8e73-2978-4133-bba9-7cc8bfaadeb2 tempest-SnapshotDependencyTests-1407213729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:41 devstack sudo[115197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 Jun 30 16:33:41 devstack sudo[115197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:41 devstack sudo[115197]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-81fb8e73-2978-4133-bba9-7cc8bfaadeb2 tempest-SnapshotDependencyTests-1407213729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54" returned: 0 in 0.866s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:41 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-81fb8e73-2978-4133-bba9-7cc8bfaadeb2 tempest-SnapshotDependencyTests-1407213729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.01fc6edd-2a77-4aa2-a58b-07a316df13e7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:41 devstack sudo[115203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.01fc6edd-2a77-4aa2-a58b-07a316df13e7 Jun 30 16:33:41 devstack sudo[115203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:42 devstack sudo[115203]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-81fb8e73-2978-4133-bba9-7cc8bfaadeb2 tempest-SnapshotDependencyTests-1407213729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.01fc6edd-2a77-4aa2-a58b-07a316df13e7" returned: 0 in 0.903s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:42 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-81fb8e73-2978-4133-bba9-7cc8bfaadeb2 tempest-SnapshotDependencyTests-1407213729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.01fc6edd-2a77-4aa2-a58b-07a316df13e7 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:42 devstack sudo[115209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.01fc6edd-2a77-4aa2-a58b-07a316df13e7 Jun 30 16:33:42 devstack sudo[115209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:43 devstack sudo[115209]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:43 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-81fb8e73-2978-4133-bba9-7cc8bfaadeb2 tempest-SnapshotDependencyTests-1407213729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54.01fc6edd-2a77-4aa2-a58b-07a316df13e7" returned: 0 in 0.734s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:43 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:UPDATE=113,cinder:DELETE=4,cinder:SELECT=75,cinder:INSERT=36 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:33:43 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-81fb8e73-2978-4133-bba9-7cc8bfaadeb2 tempest-SnapshotDependencyTests-1407213729 None] Lock "cinder-quobyte-01fc6edd-2a77-4aa2-a58b-07a316df13e7" released by "_delete_snapshot" :: held 3.635s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:43 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-81fb8e73-2978-4133-bba9-7cc8bfaadeb2 tempest-SnapshotDependencyTests-1407213729 None] Lock "cinder-quobyte-f16c4923-1db2-4aab-b44e-68cc83d65f54" released by "delete_snapshot" :: held 3.670s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:43 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-81fb8e73-2978-4133-bba9-7cc8bfaadeb2 tempest-SnapshotDependencyTests-1407213729 None] Created reservations ['39d08fe8-45a4-489a-9873-be303e17bc9a', 'f031852f-fb08-4921-8f69-1bd6644a33b3', 'd2f8c1d3-b532-4613-9d93-1afd51b68035', 'cfe1795b-cf3d-422a-b578-40bae593c19f'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:33:43 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-81fb8e73-2978-4133-bba9-7cc8bfaadeb2 tempest-SnapshotDependencyTests-1407213729 None] Delete snapshot completed successfully. Jun 30 16:33:43 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-81fb8e73-2978-4133-bba9-7cc8bfaadeb2 tempest-SnapshotDependencyTests-1407213729 None] Lock "cinder-01fc6edd-2a77-4aa2-a58b-07a316df13e7-delete_snapshot" released by "delete_snapshot" :: held 3.848s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:44 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f71f8a6d-1ed4-45b7-b84a-7801353b2374 tempest-SnapshotDependencyTests-1407213729 None] Acquiring lock "cinder-f16c4923-1db2-4aab-b44e-68cc83d65f54-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:33:44 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f71f8a6d-1ed4-45b7-b84a-7801353b2374 tempest-SnapshotDependencyTests-1407213729 None] Lock "cinder-f16c4923-1db2-4aab-b44e-68cc83d65f54-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:33:44 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=97,cinder:INSERT=27,cinder:UPDATE=112,cinder:DELETE=15 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:33:44 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f71f8a6d-1ed4-45b7-b84a-7801353b2374 tempest-SnapshotDependencyTests-1407213729 None] Acquiring lock "cinder-quobyte-f16c4923-1db2-4aab-b44e-68cc83d65f54" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:33:44 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f71f8a6d-1ed4-45b7-b84a-7801353b2374 tempest-SnapshotDependencyTests-1407213729 None] Lock "cinder-quobyte-f16c4923-1db2-4aab-b44e-68cc83d65f54" acquired by "delete_volume" :: waited 0.017s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:33:44 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fbbd7a-95f7-4509-8861-d85a4bf78f35]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:33:44 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f71f8a6d-1ed4-45b7-b84a-7801353b2374 tempest-SnapshotDependencyTests-1407213729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:44 devstack sudo[115212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 Jun 30 16:33:44 devstack sudo[115212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:45 devstack sudo[115212]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f71f8a6d-1ed4-45b7-b84a-7801353b2374 tempest-SnapshotDependencyTests-1407213729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54" returned: 0 in 0.808s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f71f8a6d-1ed4-45b7-b84a-7801353b2374 tempest-SnapshotDependencyTests-1407213729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:45 devstack sudo[115217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54 Jun 30 16:33:45 devstack sudo[115217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:45 devstack sudo[115217]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:45 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f71f8a6d-1ed4-45b7-b84a-7801353b2374 tempest-SnapshotDependencyTests-1407213729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-f16c4923-1db2-4aab-b44e-68cc83d65f54" returned: 0 in 0.787s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:45 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f71f8a6d-1ed4-45b7-b84a-7801353b2374 tempest-SnapshotDependencyTests-1407213729 None] Lock "cinder-quobyte-f16c4923-1db2-4aab-b44e-68cc83d65f54" released by "delete_volume" :: held 1.651s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:45 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-f71f8a6d-1ed4-45b7-b84a-7801353b2374 tempest-SnapshotDependencyTests-1407213729 None] Created reservations ['3507de36-7071-4a62-b9db-c44e7db6b7ec', 'be4d914c-3acb-44b3-a0d5-a623c867153c', '02a12317-31d7-4f8d-98ec-dac5e6ffd407', 'c45e2015-cdd8-43eb-8121-a2e7a6082871'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:33:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f71f8a6d-1ed4-45b7-b84a-7801353b2374 tempest-SnapshotDependencyTests-1407213729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:33:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f71f8a6d-1ed4-45b7-b84a-7801353b2374 tempest-SnapshotDependencyTests-1407213729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:33:46 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f71f8a6d-1ed4-45b7-b84a-7801353b2374 tempest-SnapshotDependencyTests-1407213729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:33:46 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f71f8a6d-1ed4-45b7-b84a-7801353b2374 tempest-SnapshotDependencyTests-1407213729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:33:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f71f8a6d-1ed4-45b7-b84a-7801353b2374 tempest-SnapshotDependencyTests-1407213729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:33:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f71f8a6d-1ed4-45b7-b84a-7801353b2374 tempest-SnapshotDependencyTests-1407213729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:46 devstack sudo[115226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:33:46 devstack sudo[115226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:46 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f49f0463-07b4-4a27-a3fd-7fe1ec457431 tempest-SnapshotDependencyTests-1407213729 None] Acquiring lock "cinder-488befa4-fb66-464a-bb09-584ff9c36bcc-delete_volume" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:33:46 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f49f0463-07b4-4a27-a3fd-7fe1ec457431 tempest-SnapshotDependencyTests-1407213729 None] Lock "cinder-488befa4-fb66-464a-bb09-584ff9c36bcc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:33:46 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f49f0463-07b4-4a27-a3fd-7fe1ec457431 tempest-SnapshotDependencyTests-1407213729 None] Acquiring lock "cinder-quobyte-488befa4-fb66-464a-bb09-584ff9c36bcc" by "delete_volume" {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 30 16:33:46 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f49f0463-07b4-4a27-a3fd-7fe1ec457431 tempest-SnapshotDependencyTests-1407213729 None] Lock "cinder-quobyte-488befa4-fb66-464a-bb09-584ff9c36bcc" acquired by "delete_volume" :: waited 0.020s {{(pid=93781) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 30 16:33:46 devstack cinder-volume[93781]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d1cc6e-154b-48d5-aba3-e976d0eff635]: (4, 'qcow2') {{(pid=94559) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 30 16:33:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f49f0463-07b4-4a27-a3fd-7fe1ec457431 tempest-SnapshotDependencyTests-1407213729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-488befa4-fb66-464a-bb09-584ff9c36bcc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:46 devstack sudo[115228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-488befa4-fb66-464a-bb09-584ff9c36bcc Jun 30 16:33:46 devstack sudo[115228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:46 devstack sudo[115226]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:46 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f71f8a6d-1ed4-45b7-b84a-7801353b2374 tempest-SnapshotDependencyTests-1407213729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.729s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:46 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-f71f8a6d-1ed4-45b7-b84a-7801353b2374 tempest-SnapshotDependencyTests-1407213729 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:33:46 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-f71f8a6d-1ed4-45b7-b84a-7801353b2374 tempest-SnapshotDependencyTests-1407213729 None] Deleted volume successfully. Jun 30 16:33:46 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f71f8a6d-1ed4-45b7-b84a-7801353b2374 tempest-SnapshotDependencyTests-1407213729 None] Lock "cinder-f16c4923-1db2-4aab-b44e-68cc83d65f54-delete_volume" released by "delete_volume" :: held 2.641s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:47 devstack sudo[115228]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f49f0463-07b4-4a27-a3fd-7fe1ec457431 tempest-SnapshotDependencyTests-1407213729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-488befa4-fb66-464a-bb09-584ff9c36bcc" returned: 0 in 0.851s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:47 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f49f0463-07b4-4a27-a3fd-7fe1ec457431 tempest-SnapshotDependencyTests-1407213729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-488befa4-fb66-464a-bb09-584ff9c36bcc {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:47 devstack sudo[115235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-488befa4-fb66-464a-bb09-584ff9c36bcc Jun 30 16:33:47 devstack sudo[115235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:48 devstack sudo[115235]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f49f0463-07b4-4a27-a3fd-7fe1ec457431 tempest-SnapshotDependencyTests-1407213729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba/volume-488befa4-fb66-464a-bb09-584ff9c36bcc" returned: 0 in 0.853s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:48 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f49f0463-07b4-4a27-a3fd-7fe1ec457431 tempest-SnapshotDependencyTests-1407213729 None] Lock "cinder-quobyte-488befa4-fb66-464a-bb09-584ff9c36bcc" released by "delete_volume" :: held 1.747s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:48 devstack cinder-volume[93781]: DEBUG cinder.quota [None req-f49f0463-07b4-4a27-a3fd-7fe1ec457431 tempest-SnapshotDependencyTests-1407213729 None] Created reservations ['03a65883-98e6-419b-bdf3-0ab27961b17b', 'cb1d2d50-d79e-478b-ae5e-d0507f75e58c', '2cb879f8-b9ba-413d-9a44-f81d0fe3d3cb', 'ba0a23e1-7a7b-4de4-88e5-80a9636b2e0b'] {{(pid=93781) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 30 16:33:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f49f0463-07b4-4a27-a3fd-7fe1ec457431 tempest-SnapshotDependencyTests-1407213729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 30 16:33:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f49f0463-07b4-4a27-a3fd-7fe1ec457431 tempest-SnapshotDependencyTests-1407213729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 30 16:33:48 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f49f0463-07b4-4a27-a3fd-7fe1ec457431 tempest-SnapshotDependencyTests-1407213729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a': None} {{(pid=93781) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 30 16:33:48 devstack cinder-volume[93781]: DEBUG cinder.volume.drivers.quobyte [None req-f49f0463-07b4-4a27-a3fd-7fe1ec457431 tempest-SnapshotDependencyTests-1407213729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-13a52c3c-ec94-495f-9c86-b18febce6a3a'] {{(pid=93781) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 30 16:33:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.lockutils [None req-f49f0463-07b4-4a27-a3fd-7fe1ec457431 tempest-SnapshotDependencyTests-1407213729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93781) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 30 16:33:48 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f49f0463-07b4-4a27-a3fd-7fe1ec457431 tempest-SnapshotDependencyTests-1407213729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 30 16:33:48 devstack sudo[115238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba Jun 30 16:33:48 devstack sudo[115238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 30 16:33:49 devstack sudo[115238]: pam_unix(sudo:session): session closed for user root Jun 30 16:33:49 devstack cinder-volume[93781]: DEBUG oslo_concurrency.processutils [None req-f49f0463-07b4-4a27-a3fd-7fe1ec457431 tempest-SnapshotDependencyTests-1407213729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/771643386658a1d16e55692a7fa749ba" returned: 0 in 0.751s {{(pid=93781) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 30 16:33:49 devstack cinder-volume[93781]: DEBUG cinder.manager [None req-f49f0463-07b4-4a27-a3fd-7fe1ec457431 tempest-SnapshotDependencyTests-1407213729 None] Notifying Schedulers of capabilities ... {{(pid=93781) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 30 16:33:49 devstack cinder-volume[93781]: INFO cinder.volume.manager [None req-f49f0463-07b4-4a27-a3fd-7fe1ec457431 tempest-SnapshotDependencyTests-1407213729 None] Deleted volume successfully. Jun 30 16:33:49 devstack cinder-volume[93781]: DEBUG cinder.coordination [None req-f49f0463-07b4-4a27-a3fd-7fe1ec457431 tempest-SnapshotDependencyTests-1407213729 None] Lock "cinder-488befa4-fb66-464a-bb09-584ff9c36bcc-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=93781) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 30 16:33:58 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=9,cinder:INSERT=3,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 30 16:33:59 devstack cinder-volume[93781]: DEBUG dbcounter [-] [93781] Writing DB stats cinder:SELECT=15,cinder:INSERT=7,cinder:UPDATE=21,cinder:DELETE=1 {{(pid=93781) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}